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FOREWORD 


This document presents the results of work performed by Martin 
Marietta Corporation's Denver Division under contract to the 
National Aeronautics and Space Administration's Marshall Space 
Flight Center. This Phase I Final Report was prepared in par- 
tial fulfillment of Contract NAS8-29024, Conceptual Design Study 
for a Teleoperator Visual System .. The Contracting Officer's 
Representative is Mr. Carl T. Huggins. 
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INTRODUCTION 


I. 


Plans for extending man's exploration and understanding of space 
include the use of remotely controlled teleoperators which, when 
controlled from a safe, habitable location, have the advantage 
of using man's ability to make decisions as unforeseen conditions 
arise while permitting him to stand off from any hazardous condi- 
tions . 

Teleoperators for space application are generally classified in 
three distinct types: (1) systems attached to a manned space- 

craft; (2) unmanned roving vehicles; and (3) free-flying systems. 
These systems, conceptually shown in Fig. 1-1, are extremely com- 
plementary, in that the first operates solely within the range of 
a manned spacecraft [such as the 15.3-m (50.0-ft) manipulator 
presently baselined in the Shuttle Program for use in cargo han- 
dling and docking] , while the second operates on lunar or planetary 
surfaces (in a similar manner as the Russian Lunokhod) . The third 
system takes up the gap between the other two systems by operating 
within those earth orbits unattainable by the Shuttle, as well as 
on long-range missions such as comet and asteroid exploration. 

This study is primarily concerned with the free-flying system, 
which encompasses small free-flying teleoperators (FFTOs) and the 
class of larger FFTOs commonly referred to as Space Tugs. 
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Fig. 1-2 FFTO Elements 


Ft^. J-2 FFTO Elements 

An FFTO, as shown in Fig. 1-2, generally consists of four basic 
elements: (1) a remotely controlled vehicle to provide maneuver- 

ing to and from the work. site and mobility about the satellite; 

(2) one or more manipulative devices, representative of man's 
arms and hands, to enable the performance of tasks at the work 
site; (3) a visual system, analogous to man's eyes, to allow 
viewing of the work site and task activity; and (A) a control 
and display station, remotely located in a manned spacecraft or 
on earth, from which the total FFTO mission operations are super- 
vised and controlled. The most important of these is the visual 
system since this is the primary sensor used by the FFTO opera- 
tor in accomplishing FFTO tasks. The objectives of this study 
that relate to the FFTO visual system are: 

1) To investigate visual system concepts for application to tele- 
operator operations, and, based on technical judgment, pro- 
pose a candidate for consideration by NASA for preliminary 
design; 

2) To generate a preliminary design of the concept selected by 
NASA. 
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The study was divided into two phases-r-Conceptual Design and 
Preliminary Design— each of which satisfies an object iden- 
titled above. The two phases were then subdivided into the tasks 
shown in Fig. 1-3. 

This report describes the results of the work performed during 
Phase I. 


PHASE X 


PHASE II 


REQUIREMENTS CONCEPTS DESIGN 



Fig. 1-3 Teleoperator Visual System Study Task Flow 
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II. 


SUMMARY 


This report presents the results of the work performed by Martin 
Marietta during the first phase of the conceptual design study 
for a teleoperator visual system. This phase consisted of four 
tasks: general requirements; concept development; subsystem re- 

quirements and analysis; and concept evaluation. 


A. GENERAL REQUIREMENTS 

Documents provided by NASA were reviewed and used to establish 
the general requirements and guidelines for the visual system 
(Chapter III). 


B. CONCEPT DEVELOPMENT 


Four visual system concepts were considered: direct vision; 

television; optical radar/ computer-generated displays; and ho- 
lography. These concepts are discussed in Chapters IV and V. 
Based on the general requirements, three of these concepts were 
easily eliminated. The remaining concept was television. 

A detailed investigation of TV concepts established eight poten- 
tial candidates--one monoscopic technique and seven stereoscopic 
techniques. The stereoscopic techniques were further subdivided 
into two types of sensor systems (dual and single split-field) 
and seven types of display systems (polarized, color-separated, 
helmet-mounted, Fresnel, lenticular , stereo-foveal, and foveal 
lens). Based on operator comfort, complexity, and state-of-the- 
art considerations, three candidate systems were selected for 
further investigation: monocular, dual sensor-Fresnel display, 

and dual sensor- lenticular display. 
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c. 


SUBSYSTEM REQUIREMENTS AND ANALYSIS 


As described in Chapters VI and VII, commonality between the 
candidate TV subsystems was identified so that an analysis could 
be performed on a subsystem basis, independent of the totalj vis- 
ual system. A tradeoff study was conducted between the two stereo 
scopic systems. The characteristics of each system were compared 
analytically, and a bench-type setup was constructed for both 
parametric and subjective evaluations. The lenticular display 
was eliminated from further consideration, primarily because of 
component complexity, alignment requirements, and subjective com- 
parisons with the Fresnel display. 

The stereoscopic and monoscopic subsystem analysis showed that 
the systems compared favorably in terms of general requirements 
such as bandwidth, power, weight, volume, and state-of-the-art/ 
development requirements. 


D. CONCEPT EVALUATION 


The monoscopic and stereoscopic systems were assembled and eval- 
uated using man-in-the-loop simulations. These simulations con- 
sisted of three phases: static, master-slave manipulator, and 

a six degree-of -freedom moving base. The static phase investi- 
gated camera locations and depth alignment. In the second phase, 
task panel was constructed for use with a Control Research Lab- 
oratories Model L manipulator arm and the systems were compared 
on the basis of typical FFTO maintenance operations. In the 
third phase, Martin Marietta's six-degree-of -freedom moving base, 
programmed with the FFTO maneuvering characteristics, was used 
with a scaled spinning/nutating satellite to provide data on 
system performance relative to a satellite inspection or retrieval 
mission. 

Based on the results, a hybrid stereo-monoscopic visual system 
concept was recommended. 
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III. 


A. 


1 . 


GENERAL REQUIREMENTS 


The general visual requirements are primarily based on three FFTO 
applications: satellite inspection, satellite maintenance, and 

satellite retrieval (assuming a passive or spinning/nutating 
satellite) . 

A significant amount of work has already been completed in the 
areas of FFTO mission requirements, system requirements, perfor- 
mance requirements, man-machine interface requirements, and 
flight experiments. At the start of this study we reviewed docu- 
ments received from NASA and formulated several general require- 
ments based on information in Ref 1 thru 5 and on the requirements, 
guidelines, and constraints contained in the study statement of 
work. 


MISSION REQUIREMENTS 


Satellite Inspection 

The basic tasks to be accomplished in satellite inspection are 
contained within the other two missions. This is evident since 
inspection must occur prior to maintenance, capture, or retrieval. 
As a result, inspection functions have been combined into the 
other missions; however, where only satellite inspection is to 
occur, only the inspection portion of the satellite capture and 
retrieval will apply. 

Satellite Retrieval 

The satellite retrieval mission assumes the FFTO "is in the near 
vicinity of the satellite. In all satellite retrieval tasks, it 
will be assumed that the satellites are prepared for capture. 

This preparation will include some or all of the items listed 
below: 

1) Attachment points located along the principle axes of rota- 
tion; 

2) Markings, identification coding, etc; 
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3) Capability for remote deactivation of attitude control sys- 
tems, jettisoning of appendages, etc. 

The degree to which satellite preparation is provided directly 
affects the work load the teleoperator must bear for satellite 
capture. 

Table III-l shows the overall functions for the retrieval mission 
and identifies the corresponding general visual requirements. 

3 . Satellite Maintenance 


The satellite maintenance mission includes all the functions, 
tasks, and requirements of satellite retrieval, since maintenance 
starts after attachment to the satellite. Therefore, for this 
analysis, satellite maintenance will include all requirements 
necessary for satellite capture. In addition, the satellite 
maintenance requirements assume that: 

1) Manipulators are adequate to perform all required tasks; 

2) Maintenance is performed in free space; 

3) The RFTO is attached to the satellite maintenance subject; 

4) Satellite maintenance candidates are adequately designed to 
facilitate teleoperator maintenance and repair. 

The general class of satellite maintenance missions includes re- 
pair, resupply, refurbishment, and maintenance of satellite sys- 
tems and components. The operations included in these missions 
are: 

1) Removal and replacement of modules; 

2) Maintenance, including cleaning, aligning, inspecting, at- 
taching, tightening, and calibrating; 

3) Repair, including mending, bonding, welding, patching, de- 
forming, sealing, and cutting; 

4) Updating, including adding, removing, and modifying; 

5) Deployment, including installing, assembling, and extending. 
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Table III-l Satellite Retrieval 


Function 

Teleoperator Tasks 

Teleoperator Requirements 

Visual Task 

Visual Requirements 

Stationkeeping 

- Assume position 

- Align attitude angles 

- Determine position changes 

- Maintain position 

- Monitor location of 
obstacles 

- Maneuver to position 

- Accuracy, ±30 deg 
(±0.524 rad) 

- High-accuracy-limit cycle, 
0.5 deg (0.008 rad) 

- Correct errors 

- Ranging aids 

Hold rates, 0.1 fps 
(0.03 m/sec) 

Hold position, ±2 ft 
(±0.61 m) 

- Full view of satellite 

- Locate satellite posi- 
tion in working volume 

- Estimate range 

- Estimate closing velo- 
city 

- View entire working volume 

- View volume within 25 ft 
(7.62 m) of satellite 

- Range <100 ft (<30.5 m) 

- Accuracy, ±2 ft (±0.61 m) 

- Velocity, <0.1 fps (<3.05 cm/sec) 

Determining Satellite 
Dynamics 

- Track entire satellite 

- Identify axis of rotation 

- Align attitude and body 
axis 

- Measure rotation rates 

- Measure stability about 
the axis 

- Wide field of view [60 deg 
(1.047 rad)] 

- Accuracy, TBD 

- Accuracy, TBD 

- Accuracies, 0.1 to 2 rpm 
depending on satellite 

- Measured nutation accu- 
racy, TBD 

- Estimate rotational axes 

- Estimate axis stability 

- Estimate rotational 
rates 

- Estimate direction and 
amount of attitude 
misalignments 

- Estimate alignment, with 
satellite axis of inter- 
est 

- Discern axes of rotation 

- Discern nutation angles to within 
45 deg (0.785 rad) 

- Nutation rates, <10 rpm 

- Spin rates, <100 rpm 

- Discern relative attitude alignment 
between FFTO and satellite 

- Discern relative axis alignment 
between FFTO and satellite axis of 
interest 

Satellite Inspection 

- Maneuver around satellite 

- Inspect structures and com- 
ponents 

- Circumnavigate in 2 ortho- 
gonal planes 

- Maintain distance and posi- 
tion in plane 

- Resolution, 1 in. (2.54 cm) 

- High resolution, 0.1 in. 
(0.25 cm) 

- Ascertain the general in- 
tegrity of the satellite 

- If satellite is nutating and/or 
spinning, stop relative motion to 
inspect satellite 

- Resolution, 1 in. (2.54 cm) 

- High resolution, 0.1 in. (0.25 cm) 

Locating Attachment 
Points 

- Identify attachment point 

- Inspect attachment points 

- Track attachment points 

- Lighting 

- Size resolution, 0.2 in. 
(0.51 cm) 

- Motion resolution, 5 arc- 
minutes/sec (0.001 rad/sec) 

- Ascertain docking points 

- Track docking points 

- Search satellite surface 

- Resolution, 0.2 in. (0.51 cm) 

- Motion resolution, 5 arc-minutes/ 
sec (0.001 rad/sec) 

Preparing for Capture 

- Position vehicle for capture, 

- Position manipulators 

- Synchronize effector rate 

- Attitude accuracy, ±3 deg 
(±0.052 rad) 

- Inertial axis accuracy, TBD 

- Positioning accuracy, TBD 

- Accuracy, 0.1 to 2 rpm 

- Estimate alignments 

- Estimate distance rates 

- Discern and track poten- 
tial obstructions 

- Attitude accuracy, ±3 deg 
(±0.052 rad) 

- Views to allow 3-dimensional posi- 
tioning to ±3 in. (±7.62 cm) 

- Rate accuracy, 0.1 to 2 rpm 

- View work site for possible 
obstructions 

Achieving Contact 

- Impart closing velocity 

- Maintain alignment 

- Achieve contact 

- Secure effector grasp 

- Monitor rates 

- 0.05 to 0.2 fps (1.52 to 
6.10 cm/ sec) 

- X-axis alignment, 0.2 ft 
(6.10 cm) 

- Attitude, ±3 deg 
(±0.052 rad) 

- Observe contacts 

- Adjust effector attitude 
to contact all points 

- Forces, TBD 

- Determine cluster motions 

- Discern close in range 

- Discern docking rates 

- Discern docking rates 

i 

- View for 3-dimensional positioning 
of docking device to ±1 in. 

(±2.54 cm) 

- Resolve relative rates to 0.05 fps 
(1.52 cm/sec) 

Satellite Stabilization 

- Impart despin forces 

- Monitor spin rates 

- Monitor other rates 

- Verify completion of despin 

- Forces, TBD 

- Rate measurement aids 

- Rate measurement aids 

- Decision criteria 






The satellite on-orbit maintenance missions essentially involve 
one major maintenance operation — the removal and replacement of 
modules (Ref 1 and 4). It shall, therefore, be assumed that the 
primary maintenance requirements are associated with removal and 
replacement. A detailed analysis of this task is shown in Table 
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Table III- 2 Satellite Maintenance 
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B. 


VISUAL GUIDELINES AND IMPOSED REQUIREMENTS 


1. The visual system will consist of the sensor, its associated 
onboard components (optics, data processing equipment, de- 
ployment mechanisms, control elements, etc), and the corre- 
sponding display and control elements at the remote control 
station. 

2. Any object whose smallest dimension is 0.0625 in. (1.59 mm) 
or greater and which appears in a field of view with a 1:1 
magnification and a contrast ratio equal to or greater than 
1.5:1 shall be identifiable by the operator. 

3. Illumination will be by direct or reflected sunlight, or by 
artificial light sufficient for 40 ft-lamberts (137 Cd/m 2 ) 
from the base of the working volume. 

4. The console for the system output display shall have a sur- 
face area no greater than 400 sq in. (2581 sq cm) , and shall 
be designed for viewing at a distance of 18 to 24 in. (46 to 
61 cm) from the eye of the operator. The light output from 
the display shall be sufficient for normal observation in an 
ambient operator light of 40 ft-candles (431 lux). 

5. The system's field of view. shall accommodate the entire work- 
ing volume of the manipulators, based on typical teleopera- 
tor manipulator activity during the satellite inspection, 
maintenance, and retrieval missions. 

6. Commonality should be considered for all applications in 
earth orbit. 

7 . Manipulator controls are of three general types with many 
variations (i.e., exoskeleton, switch box, hand controller, 
analog replica, etc). The functions will be identified when- 
ever the controls of the manipulative device interface with 
the display and controls of the viewing system. 

8. The design should show operating feasibility for each ele- 
ment of the system. Some breadboarding may be required 
during the preliminary design phase. 

9. The design shall reflect state-of-the art technology appli- 
cable to a final design in the 1975 time frame. 
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In addition, three other aspects of the. system are of great im- 
portance: (1) the integration of the controls of the visual sen- 

sor and the manipulator under operating conditions; (2) the inte- 
gration of the visual display with the other data display at the 
man-machine interface; and (3) the FFTO system baselined for this 
study, which is defined in Ref 2. 


C. FFTO CHARACTERISTICS 


The FFTO maneuvering and stabilization characteristics, based on 
Ref 2, are shown in Tables III-3 and III-4, respectively. 


Table III-3 FFTO Free-Space Maneuvering Characteristics 


HOW: 

Sixteen Thrusters at 5 lb (22.2 N) Thrust Each and 1.8 ft-lb-sec 
(2.44 J-sec) Control Moment Gyros (CMGs) 

Range - Range Rate Radar 

TV-Line of Sight Guidance 

Man in the Loop-Remote Console Operation 

6 Degrees of Freedom Control 

Thrusters for Translation and CMG Desaturation 
CMGs for Attitude Control 

HOW SLOW: 

Translation - 0.02 ft/sec (0.61 cm/sec) minimum bit 
Attitude - essentially zero (CMG Mode) 

HOW FAST: 

Translation - X Axis 1.43 ft/sec 2 (0.44 m/sec 2 ) 

- Y, Z Axis 0.72 ft/sec 2 (0.22 m/sec 2 ) 

Attitude - Roll 39 deg/sec 2 (0.681 rad/sec 2 ) 

(Thruster Mode) - Pitch 38 deg/sec 2 (0.663 rad/sec 2 ) 

- Yaw 41 deg/sec 2 (0.716 rad/sec 2 ) 

HOW FAR: 

0 to 10,000 ft (0 to 3048 m) from Shuttle 

HOW LONG: 

2.5 hr/mission without battery recharge, 15,000 lb-sec 
(66,723 N-sec) total impulse with battery recharge 

HOW FLEXIBLE: 

Translation Modes 

• Command Acceleration 

• Minimum Bit 

• Range Hold 


Attitude Modes 

• Discrete Level Rate/Attitude Hold 

• Command Acceleration 

• Proportional Rate/Attitude Hold 


Malfunction Mode 

• 3 Rotational, 2 Translation Degrees of Freedom 


Circumnavigation 

• Combine Range Hold and Manual Attitude Control Modes 
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Table III-4 FFTO Stabilization Characteristics 


HOW: 

Radar Range Sensor 





Rate Gyro Attitude Rate Sensor 




Control Torques by 

- Reaction Jet Thrusters 

- Control Moment Gyros 





5 Modes 






a) - 

Direct Acceleration Commands 




(2) - 

High-Level Command Rate 




(3) - 

Low-Level Command 

Rate 




(4) - 

High-Level Proportional Rate 




(5) - 

Low-Level Proportional Rate 



WHAT RATE : 

Mode 

Angular Rate, deg/sec (rad/sec) 




(i) 

Unlimited 





(2) 

6.0 (0.105) . 





(3) 

2.0 (0.035) 





(4) 

0. 0-6.0 (0.0-0.105) 




(5) 

0. 0-2.0 (0.0-0.035) 



WHAT ACCURACY: 

Mode 

Residual Rate, deg/sec (rad/sec) 

Control Threshold 


(i) 

Manual [0.3 deg/sec (0.005 rad/ 
sec) minimum] 

Manual 


(2) 

0.3 (0.005) 


±10. 

0 deg (±0.175 rad) 


(3) 

0.1 (0.002) 


±1 . 

0 deg (±0.017 rad) 


(4) 

0.1 (0.002) 


±1 . 

0 deg (±0.017 rad) 


(5) 

0.1 (0.002) 


±1 . 

0 deg (±0.017 rad) 


Range Hold 



±10. 

0 ft (±3.05 m) 

HOW FAST: 

Mode 

Angular Acceleration, deg/sec 2 (rad/sec 2 ) 



Pitch 

Yaw 

Roll 


(1) 

20 (0.349) 

20 (0.349) 

37 (0.646) 


(2) 

20 (0.349) 

20 (0.349) 

37 (0.646) 


(3) 

0.39 (0.007) 

0.39 (0.007) 

0.74 (0.013) 


(4) 

0.39 (0.007) 

0.39 (0.007) 

0.74 (0.013) 


(5) 

0.39 (0.007) 

0.39 (0.007) 

0.74 (0.013) 
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VISUAL SYSTEM CONCEPTS 


The design of a visual system depends on the specific require- 
ments of the application involved. Size, weight, and bandwidth 
limitations must be weighed against the amount of visual infor- 
mation required by the viewer. Consequently, a major factor that 
must be considered in developing such a system is the degree of 
commonality between the actual information available to the sen- 
s'or and the information relayed to the viewer. The information 
parameters available to the sensor include intensity, color, co- 
ordinate information, phase information, field of view, and par- 
allax. The number of parameters relayed to the viewer initially 
depends on the acquisition capability of the sensor. To detect 
all of the above parameters in a manner comparable to direct vi- 
sion, the sensor must acquire and transmit any information capa- 
ble of human visual perception; i.e., intensity, color, stereo 
parallax, etc. A display system must then be designed to pre- 
sent all the available visual information to the viewer in a man- 
ner most compatible with normal human vision. The display de- 
sign must therefore consider apparent field of view, display 
brightness, display-to-viever distance, eyestrain, freedom of 
movement, ease of image registration, and resolution. The loss 
or reduction of any of these parameters will result in a reduc- 
tion of the operator's visual realization of the scene. 

Visual systems vary significantly in sophistication, and range 
from direct viewing to indirect concepts such as holography. 



A. 


VISUAL SYSTEM CONCEPT 1: DIRECT VIEWING 


This concept, illustrated in Fig. IV-1, consists of direct vision 
by the operator through windows located at the control station. 
This particular concept is the simplest, and probably the most 
acceptable to the operator because it is a natural and reliable 
system, but it has two severe limitations. First, the field of 
view is easily obstructed and it requires the operator to be 
physically close to the working volume. Based on the FFTO gen- 
eral requirement of operational distances ranging up to 3048 m 
(10,000 ft), this concept cannot be considered the primary visual 
system. 


B. VISUAL SYSTEM CONCEPT 2: TELEVISION 


Television systems, shown typically in Fig. IV-2, have proven 
very effective as indirect visual systems. Their resolution, 
bandwidth, power, and mass requirements are quite satisfactory 
for use in space. In fact, several types of TV sensor tubes 
have been and are currently being produced for space application. 
These tubes are either of the vidicon or image orthicon type. 

The basic vidicon tube suffers from insensitivity, and both types 
exhibit lag, which causes a "smearing" of the displayed picture 
for fast-moving objects. Improved versions presently under de- 
velopment offer high resistance to damage and excellent visual 
information transfer. 

The successful use of monoscopic TV as indirect visual systems 
has been demonstrated in numerous applications on earth and in a 
space environment. From a visual information standpoint, however, 
a stereoscopic system is more comparable to direct vision than a 
monoscopic system since stereoscopic depth perception is conveyed 
to the viewer. One must recognize that if resolution and field 
of view are held constant, a stereoscopic system will require 
twice the power, bandwidth, mass, and volume of a monoscopic sys- 
tem. If the latter parameters are critical, single-camera stereo- 
scopic TV system using a split-image field can be developed by 
sacrificing some resolution and field of view. However, based 
on operator performance and task requirements, a single stereo- 
scopic system may be equivalent to a monoscopic system needing 
two views (sensors) . Consequently, both monoscopic and stereo- 
scopic TV systems must be given strong consideration. 


IV-2 








(Ii 


DISPLAY 


-PUTER-GENERATED TV 


s computer-generated TV display, 
sd to convert sensor range infor- 
ile, from an optical mapping radar 
i — into cathode-ray-tube intensity 


iting a visual display with pseudo- 
:ombined with actual numerical infor- 
This information might consist of 
.ve geometry, range-range rate en- 
positions. In addition, considera- 
•uter draw the display aids required 
d over the video image of the target, 
zed that while a computer-generated 
.nt part in the total visual system, 
it should be specifically provided 
traightf orward TV system concept. 







D. 


VISUAL SYSTEM CONCEPT 4: HOLOGRAPHY 


Holography is theoretically the most complete sensor available in 
that it records both amplitude and phase information about each 
point in the field of view. However, the phase information is 
of little benefit since the human eye is a square-law detector 
and has no means of perceiving phase. Also, it is likely that a 
holographic sensor subsystem would be monochromatic, and would 
therefore provide no color information. 


Figure IV-4 shows a holographic sensor system concept. Intense 
coherent radiation is supplied by the optically amplified pulsed 
laser mounted adjacent to the camera. The hologram might be re- 
corded on erasable film and processed in a heat cavity. The film 
could then pass by a laser scanning system that reads the film 
and transmits the information. Afterward, the film could be 
erased and recycled. 


The various aspects of holography as an indirect visual system 
involve developmental recording media, film readers, and erasing 
techniques. Some of the more promising recording media and film 
readers are described in the following paragraphs. 


Heat 

Development 

Cavity 


High- 

Resolution 
Laser Scanner 


Film 

Eraser 


Erasable 

* 

Reusable Film 



Window (Narrow 
band Interference 
Filter) 


Pulsed 

Laser 


Fig . IV-4 Holographic Sensor Concept 
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1 . 


Recording Media 


a. Free-Radical-Dye Films - Free-radical photographic films are 
principally used in duplicating aerial negatives, electron beam 
recording, and camera or picture-taking applications. The latent 
images are developed by being irradiated for a few seconds with' 
uniform illumination that is within the absorption wavelength of 
the dye and outside its initial spectral sensitivity. The films 
are fixed by heating then in a small oven near 120° C for 3 
minutes . 

Free-radical-dye films are inherently less grainy than silver- 
halide films and have inherently higher resolutions — in excess 
of 1500 lines per mm. However, after they have been initially 
prepared, their shelf life is limited, and ranges from only a 
few days at normal room temperatures to a few weeks when refrig- 
erated. Thus, their great advantage in being able to use dry 
processing to develop the latent images into visible images is 
largely negated by the need to use only freshly prepared films. 

In addition, such films are not reusable. 

b. Photoplastic Films - There has been some development of re- 
cording on photoplastic film. However, the process is slow, has 
inherently low resolution, and requires complicated systems (in- 
cluding Schlieren optics) for readout. It is not applicable to 
the present purposes at the current state-of-the-art. 

2. Film Readers 


a. Flying-Spot Scanners - Flying-spot scanners are not new in con- 
cept. In a typical embodiment, a precision high-intensity cath- 
ode ray tube with a screen diameter of about 10 cm (4 in.) is 
used to produce a small spot of light. This spot can be placed 
accurately at any of approximately 16 x 16 6 points in a square 
raster on the tube screen (4096 x 4096 points) , in any address- 
able sequence of scan pattern. If the tube screen is now imaged 
by an optical system onto film-stored data, the light passing 
through the film will be modulated in accord with the stored 
data. This modulation, in turn, is read by a photosensitive de- 
tector behind the film, and the resulting electrical signal can 
be telemetered at any desired data rate. In this system, the 
telemetry rate is determined by the scanning speed and limited by 
the persistence of the tube screen. This is a relatively inef- 
ficient process, in that only about 1% of the light produced in 
the spot can reach the film. Furthermore, the size of the light 
spot will suffer from lens aberrations and diffraction. Finally, 
the cathode ray and photosensitive detector apparatus is relatively 
large and requires considerable power. 
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b. Electron-Beam Scanners - Some of the limitations of flying- 
spot scanners can be overcome by electron-beam scanners, but with 
the substitution of other problems. In this concept, since an 
electron-beam is used directly to scan the film, the specially 
prepared film must be scanned in a high vacuum. This gives rise 
to a host of mechanical, power supply, and environmental problems, 
especially since film processing is also required. 

c . Laser Beam Scanners - Since the coherent and monochromatic 
properties of laser beams make it relatively easy to produce dif- 
fraction-limited optical systems for these light sources, high- 
resolution scanners are possible with lasers. Mechanical mir- 
rors can deflect the light beam at rates consistent with plane- 
tary-distance communication data rates, and electro-optical crys- 
tal "beam-bending" techniques can produce high data rates. Ex- 
acting mechanical tolerances, weight, and power are usually the 
major problems encountered with these concepts in spacecraft 
situations. 

Based on the above discussions, it is apparent that holography is 
a developmental technology not applicable to indirect visual sys- 
tems. Resolution requirements, film speed, and other recording 
media requirements have not yet been achieved, and it is ques- 
tionable whether available film readers are capable of resolving 
holographic imagery. In light of the developmental nature of 
holography and its possible system components, it cannot logically 
be considered an indirect visual system candidate based on the 
general requirement of a "final design" in the 1975 time frame 
and a subsequent 6-9 month development period. 


E. CONCEPT RECOMMENDATIONS 


Present holography and computer-generated-display technology is 
far behind TV technology for indirect visual systems. Holography 
systems are highly developmental, even in their components, and 
high transmission bandwidths are inevitable with holographic tech- 
niques. Computer-generated displays may prove very useful for ob- 
ject location and/or orientation, in addition for obtaining range 
and range rate information. However, they do not convey enough 
true visual information to justify their use in a primary visual 
system. 

The present technology level of TV cameras, display tubes, and com- 
ponents is extremely advanced in its application to indirect visual 
systems, and is the only logical choice for the FFTO visual system. 
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V. 


TV SYSTEM CONCEPTS 


The considerations in Chapter XV show that a TV system is the most 
effective and efficient means of indirect vision for. teleoperator 
applications. Selecting the specific TV system or systems de- 
pends on the general requirements of the visual systems and the 
complexity of the candidates. The following sections discuss 
several possible TV system concepts. 


A. MONOSCOPIC TELEVISION SYSTEMS 


Investigations of indirect visual systems have concentrated on 
monoscopic systems because of their inherent simplicity. A mono- 
scopic TV system optimizes resolution, bandwidth, power, mass, 
dimensions, and controls with minimum complexity. Intensity, 
x-y coordinate information, field of view, and resolution are 
all relayed to the viewer with minimal reduction 

Several types of TV sensor tubes have previously been used in 
space and space simulation applications and are presently under- 
going further development to correct their apparent shortcomings. 
Improved image orthicon tubes, called image intensifier orthicons 
(ITOs) , are being developed to reduce the lag inherent in basic 
vidicons, but they are delicate and difficult to manufacture. 

The secondary electron conduction (SEC) vidicons used extensively 
during the Apollo missions offer higher sensitivity (approaching 
the image orthicon) , yet are more rugged and have improved lag 
characteristics. The most recent sensor tube available, first 
used on Apollo 15, is also a vidicon but has a silicon intensi- 
fier target (SIT) that is highly resistant to damage by direct 
sunlight. In addition, it exhibits a high sensitivity with low 
lag. The SIT vidicon is the type most applicable for the severe 
lighting conditions encountered in space. The specific tube 
depends on the application and environment at hand, but the camera 
choices are numerous. 

As mentioned earlier, the only visual information not relayed to 
the viewer by a monocular system is stereo parallax and color. A 
color TV system adds a new dimension of realism and may be worth 
the increased power and bandwidth, depending on the application. 
Probably the greatest visual information loss in the monocular 
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system is the loss of stereo parallax, or depth perception. How- 
ever, by placing a mirror in the field of view of a monoscopic 
TV system, the viewer is given an additional orthogonal view that 
provides 3-D information. 

Task simulations have shown that such a mirror system — or a 
second, properly positioned camera — can greatly enhance task 
performance. It has yet to be determined whether the realistic 
visual depth perception of a properly designed stereoscopic TV 
system will enhance task performance over and above that achieved 
using an improved monoscopic system. 


B. STEREOSCOPIC TELEVISION SYSTEMS 


The most natural and obvious solution to the problem of depth 
perception is the introduction of stereoscopic disparity between 
two simultaneously visible images. A number of stereo techniques 
presently under investigation are discussed below. 

1. Sensors 

To operate successfully a stereoscopic TV sensor must acquire two 
images from different aspect angles. The most obvious configura- 
tion for achieving this is a dual-camera system that maintains 
standard TV resolution (see Fig. V-l) . However, if reduced band- 
width, power, weight, and volume are desired at the expense of 
sensor resolution and field of view, the field of view can be 
optically split to enable the sensing of both right and left 
stereo fields by a single camera. Figure V-2 demonstrates how 
mirrors and/or prisms might be used to split the field and mini- 
mize stereoscopic distortion; the proper right-to-left image 
orientation is restored in the image projection system. 

Note that a more complex optical system is required for the single- 
camera stereo TV subsystem than for the other TV subsystem. The 
optical train could be somewhat simplified by eliminating the image 
rotation elements, but such a simplification would result in dis- 
tortion of the stereo-optic image and additional horizontal-field 
limitations. Furthermore, the resolution capabilities of even 
standard TV systems represent a significant visual limitation. 
Unless bandwidth and power requirements are extremely critical, 
the sacrifice in resolution inherent in a split-field system is 
unwarranted. Since resolution is a prime importance to FFTO per- 
formance, we will limit our evaluation of stereoscopic systems to 
those with a dual-camera sensor subsystem and standard TV resolu- 
tion. 
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Fig. V-l Dual-Camera Stereo System 



Fig. V-2 Single-Camera Stereo System 



Display 


a. Polarized Display - A well known and widely used method of 
stereo projection relies on using cross-polarized filters in con- 
junction with cross-polarized spectacles to separate the right 
and left stereo images. The stereoscopic display, as shown in 
Fig. V-3, is generated by projecting the images from the right 
and left TV monitors through polarized filters onto a ground- 
glass or liquid-crystal screen. Resolution and color informa- 
tion are the same as for monoscopic color TV. The viewer is not 
confined to seeing a small area, but if he tilts his head to the 
side he will see double images. The cross-polarized spectacles 
can cause eyestrain when viewing peripheral instruments and ob- 
jects, and if the viewer has to look through any polarized win- 
dows or filters, additional eyestrain and confusion will result. 

b . Color-Separated Display - The primary disadvantages of using 
polarized glasses can be eliminated by color-coding the two images 
and wearing narrowband, color-coded spectacles. This concept, 
illustrated in Fig. V-4, allows almost natural observation of 
peripheral objects but introduces increased eyestrain when view- 
ing- the display since one eye will see a red image and the other 
will see blue. A disadvantage of this concept is that the color 
information in the scene is lost. Still in all, the viewer is 
free to move his head in any manner without losing stereoscopic 
depth perception. 

Both the polarization and color-separated stereo display concepts 
described above overcome the restriction of viewer position, but 
only at the expense of viewer confort, versatility, and illumina- 
tion efficiency. 





a. Helmet-Mounted Display - This type of display, shown in Fig. 
V-5, is worn like a pair of eyeglasses, the temple pieces of which 
are minature cathode-ray tubes. An optics system allows objects 
projected onto these tubes to be seen by the user as virtual im- 
ages some distance in front of him. Prisms allow the user to see 
both the synthetic objects and the actual furnishings and features 
of the surrounding environment simultaneously. Special high-speed 
hardware makes real-time displaying possible by continuously moni- 
toring the position and orientation of the user’s head and by con- 
tinuously updating the information displayed to the user as he 
moves about. 


Helmet- or head-mounted displays can be used to generate impres- 
sive visual effects, but again, the cumbersome headgear must be 

o a A 



Fig. V-5 Helmet-Mounted Stereo Display Concept 
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d. Fresnel Display - A simple, but very realistic, stereoscopic 
display concept is .to use two monitors (one for each stereo image), 
two imaging lenses, and a fresnel display screen to direct the 
right and left images to the corresponding eyes of the viewer 
(see Fig. V-6) . The face of each monitor is projected through 
its corresponding image lens onto the fresnel screen, which acts 
as a field lens and forms a separate exit pupil for each image. 

The size and shape of each exit pupil is predetermined by the 
size and shape of the imaging lenses, and the display-to-viewer 
distance is set by the focal length of the screen. 

This concept has numerous advantages over other stereo displays. 
Since the fresnel screen collects light over a large field and 
concentrates it at the exit pupils, image illumination (or power 
efficiency) is optimized. In addition, the apparent field of 
view can be designed to accommodate nearly full peripheral vision, 
an important comfort factor in stereo viewing. No glasses or 
other viewing aids are required, so random viewing of peripheral 
displays and instruments is natural and effortless. No refocusing 
of the eyes is necessary. The two optical axes cross in the image 
plane, providing maximum ease of stereo registration. All resolu- 
tion and color information is retained and presented to the viewer 
in a natural way. Finally, the system is simple and compact, and 
is capable of occupying less space than any of the other concepts 
presented here. 



Fig . V-6 Fresnel Stereo Display Concept 
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Fig. V-7 Lenticular Stereo Display Concept 
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c. FOVEAL-PERIPHERAL SYSTEMS 


A number of indirect visual systems have been proposed to compro- 
mise between resolution and bandwidth in past applications. The 
most popular concept has been to match system resolution to visual 
acuity on the theory that, since visual acuity is greater at the 
central or foveal region of the retina than at the edges, the 
resolution of the TV system should also diminish at the edges. 

The fall-off in resolution can occur in steps or continuously, 
and can be designed to approximate the visual acuity of the eye. 
However, such a design assumes that the eye will have to be con- 
tinuously focused on the center of the display for optimum visual 
performance. Some of the pertinent hybrid systems that have been 
proposed are described below. 

1. Stereo Foveal - Mono Peripheral System 

This proposed hybrid system consists of a dual display, in which 
a small, central portion is stereoscopic and the surrounding por- 
tion is low-resolution monoscopic. The basic approach is to re- 
duce bandwidth requirements by matching the size of the stereo- 
scopic display to the foveal vision of the eye. The prototype 
system shown in Fig. V-8 , uses a wide-peripheral-field camera and 
a stereoscopic narrow-field camera with a system of mirrors and 
prisms. By coupling the zoom lenses of the cameras, their field 
registration is held constant. 

The video output from each camera is fed into its respective dis- 
play tube, and a system of lenses, mirrors and beam-splitters is 
then used to rear-project a real, superimposed, two-field concen- 
tric image on a screen. A liquid-crystal screen is used to ob- 
tain high resolution and a controlled scattering angle. The stereo 
field is divided into vertical strips of left and right subfields, 
and a vertical lenticular faceplate is placed over the part of the 
screen where the stereo portion of the display is registered. 

This system has two fundamental limitations: first, a visually 

disturbing, image discontinuity exists at the edge of the stereo 
display, and secondly, the poor image quality of the peripheral 
field is inadequate for inspection or task performance. Conse- 
quently, an oculometer or other eye tracking device must be used 
to track the viewer f s eye movement so that the sensor, and hence 
the stereo-f oveal portion of the display, can be slaved to it. 
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2 . 


Variable Resolution 


This display and sensor package is similar to the stereo-f oveal 
system, and consists of specially designed lenses that image the 
screen on the camera faceplate such that a higher resolution is 
maintained in the center of the field. A similar lens is used 
to project the image onto the display. These lenses, typified 
in Fig. V-9, are designed to approximate the resolution capabili- 
ties of the eye and apply equally to either monoscopic or stereo- 
scopic visual systems. However, as in the previous hybrid sys- 
tem concept, an eye-tracking device is required to make the sys- 
tem practical on a real-time operational basis. 



D. SYSTEM RECOMMENDATIONS 


A monoscopic TV system will provide satisfactory resolution, band- 
width, power, and mass with minimum complexity. In addition, TV 
system state-of-the-art is much more highly developed than that 
of other indirect visual systems, and numerous space-qualified TV 
cameras are available. Consequently, a monoscopic TV system lends 
itself well to FFTO application. 
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Stereoscopic TV adds the third dimension to a visual system at 
the cost of increased bandwidth and power. The ability to per- 
ceive depth may greatly facilitate the performance of certain 
tasks and must, therefore, be given careful consideration. The 
successful operation of a stereoscopic system relies heavily on 
the display system used to relay the image to the viewer. The 
fresnel and the lenticular displays are the only stereoscopic 
displays that do not require hoods, headgear, or glasses for their 
operation. Since the ability to view and operate controls and 
instrumentation must exist in close association with viewing the 
display, concepts that require visual constraints are unaccept- 
able. 

The two unrestricted displays, lenticular and fresnel, appear 
very promising. Both produce a comfortable stereo image, either 
in color or in black and white, while optimizing illumination, 
power efficiency, and visual depth perception. At present neither 
of these systems shows considerably more promise than the other. 
The fresnel display allows a wider field of view, but it puts 
slightly greater restrictions on head movement. In contrast, the 
lenticular” display is more complex and, therefore, its alignment 
is more critical. A deeper investigation into these possible 
techniques will hopefully affect the balance between the fresnel 
and lenticular stereoscopic display systems. Until this is done, 
both must be given equal consideration. 

Foveal systems are not recommended at this time due to their in- 
herent complex requirements. However, for long-range missions, 
where power (and hence, bandwidth) is critical, and where opera- 
tion is not on a real-time basis, this system should be reevalu- 
ated. 

Therefore, three candidate TV systems are recommended for further 
investigation : 

1) Monocular systems ; 

2) Stereoscopic-fresnel display systems; 

3) Stereoscopic-lenticular display systems. 
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VI. 


SUBSYSTEM_^QUIMMNTS_FOR_THE_TV_VISUAL_SYSTEM 


The subsystems incorporated in the TV visual system are shown in 
Fig. VI-1. Those subsystems located in the FFTO are shown on the 
left and those located in the remote control station are shown on 
the right. 

The unshaded portion of the figure is generally classified as the 
telecommunication subsystem and the shaded portion is recognized 
as requiring a strong emphasis on man-machine interface considera- 
tions. 


TELECOMMUNICATIONS 



REMOTE STATION 


Receiver 

Transmitter 


Fig. VI-1 Subsystems in the TV Visual System 

When summarized at these subsystem levels, the requirements im- 
posed by the statement of work becomes: 

1) Applicable to All Subsystems: 

Reflect 1975 state-of-the-art technology 
Require limited development (6-9 months maximum) 

2) Sensor Subsystem: 

Field of view shall accommodate manipulator working volume 
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3) 


Illumination Subsystem: 


Provide 40 ft-lamberts (137 Cd/m 2 ) from the working 
surface 

4) Display Subsystem: 

Operator shall resolve an object of 1.59 mm (0.0625 in.), as- 
suming a 1:1 magnification and a display contrast ratio of 
1.5:1 

Area shall be <0.26 sq m (400 sq in.) 

Viewed from 46 to 61 cm (18 to 24 in.) 

Ambient light of 40 ft-candles (431 lux) 

5) Deployment/Articulation Subsystem: 

Support sensor in accommodating manipulator field of view 

6) Control Subsystem: 

Recognize manipulator controller variations 
Integrate visual displays with other FFTO data displays 

Two additional requirements are extremely important to provide a 
basis for subsystem analysis independent of the total system or 
man-in-the-loop simulations. The first is sensor bandwidth and the 
second is the maximum sensor field of view. 

For example, if the bandwidth required by the sensor were known, 
the following subsystem analyses could be accomplished: (1) an 

independent telecommunication subsystem study based on n sensors, 
where n = 1, 2, 3, etc, and (2) a study to establish the recom- 
mended display size per sensor. Once the maximum sensor field of 
view is established, an independent trade-off study can be con- 
ducted between the number of sensors and the complexity of the 
deployment /articulation mechanism required to cover the working 
volume/working site. 

Since no definite requirements were specified for these two param- 
eters, we made two preliminary assumptions, based on technical 
judgment: (1) the bandwidth required is 5 MHz per sensor, and 

is based on a 525-line, 30-frame/sec standard TV system, and (2) 
the sensor field of view is <60 deg (<1.047 rad). We then con- 
ducted an analysis to determine if any obvious impacts resulted 
from these assumptions and to provide some general system char- 
acteristics. The logic flow required to establish the recommended 
display size is shown in Fig. VI-2. 
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A. 


DISPLAY RESOLUTION 


The system resolution requirement specifies that any object lar- 
ger than 1.59 mm (0.0625 in.) must be identifiable by the opera- 
tor, assuming a 1:1 magnification. Using the standard 525-line 
TV monitor as a display, the vertical resolution is reduced by 
about 7% due to the loss of lines during the blanking time be- 
tween the fields. Therefore, the net vertical resolution is ap- 
proximately 488 lines, and the standard TV bandwidth is based on 
providing about the same resolution horizontally. 

In addition, experimental studies have shown that, for typical 
pictures, a "figure of merit" between 50% and 70% is indicative 
of true resolution. Taking a conservative approach by using the 
50% figure, the standard TV resolution is 244 lines; i.e., the 
smallest object to be resolved must subtend 2 lines. Hence, with 
1:1 magnification, a simple relationship exists between the display 
size and the resolution requirements: 

Monitor Height = 244 x Object Size Resolved. 


B. TOTAL DISPLAY AREA 


The, total display area must not exceed 0.258 sq m (400 sq in.). 

As the number of displays required by the visual system increases, 
the area allocated per display is reduced accordingly. Thus based 
on the total display area, and assuming a 4 to 3 monitor format, 


Monitor Height = 


Display Area 
No. of Displays 


i. 


2 


The two monitor height relationships from Sections A and B are 
shown in Fig. VI-3. 
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20 


50 





Size of Object Resolved, in. 


Fig. VI-3 Allowable Display Size 
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c. 


ALLOWABLE DISPLAY SIZE 


The allowable display size, from Fig. VI-3, is tabulated below 
No. of Displays Maximum Display Height 

1 -38.8 cm (15.25 in.) 

2 31.1 cm (12.25 in.) 

3 25.4 cm (10.00 in.) 

4 22.0 cm (8.65 in.) 

Note that the maximum display height results from resolution 
limits, not display area constraints. The minimum display size 
must be based on man-machine requirements. 


D. MINIMUM MONITOR HEIGHT 


The ability of the operator to resolve an object is a function of 
the object’s size and range. This relates directly to the visual 
angle subtended by the eye. The visual angle, ot, is given by 


ot 


2 tan 


H ~ 
488 D » 


where H is the monitor height and D is the viewing distance. 

Figure VI-4 shows the relationship between the visual angle sub- 
tended and the allowable display height and viewing distance. 
Malone (Ref 1) indicates that the threshold for operators view- 
ing a TV display is about 5 arc-minutes (0.0014 rad). Thus, a 
typical monitor display (based on the average viewing distance) 
would have a minimum size of 19.0 ± 2.5 cm (7.5 ± 1.0 in.). Up 
to four monitors are acceptable to stay within the allowable 
display area. 
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Fig. VI-4 Subtended Visual Angles 



SENSOR FIELD OF VIEW 


A 60-deg (1.047-rad) maximum sensor field of view establishes two 
visual system parameters: the maximum object size displayed and 

the theoretical minimum object size resolved at the display. 


SIZE OF OBJECT DISPLAYED 


The size of the object displayed is only dependent on the sensor- 
object range and is given by, 


S = 2R tan 



where S is 
and FOV is 
VI-5. 


the size of the object, R is the range to the object, 
the field of view. This relationship is shown in Fig. 


SIZE OF OBJECT RESOLVED 


The size of the object resolved on the display is a function of 
the display resolution. Based on the 244-line resolution, 

Object Size Resolved ■ Object Size Displayed 
This relationship is also shown in Fig. VI-5. 


SUMMARY 


The basic subsystem requirements were reviewed and are within the 
guidelines established for the visual system in Chapter III. Thus, 
the subsystem analysis will be performed on the basis of a 5-MHz 
sensor bandwidth and a 60-deg (1. 047-rad) maximum sensor field of 
view. These requirements will be reviewed and modified, if neces- 
sary, at the completion of the subsystem requirements analysis. 



Sensor Field of View 
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Fig. VI-5 Displayed and Resolved Object Sizes 



VII. 


SUBSYSTEM REQUIREMENTS ANALYSIS 


The three candidate approaches for satisfying the teleoperator 
visual requirements have many subsystem elements in common. These 
elements, consisting of cameras, monitors, lighting requirements, 
etc, can be analyzed in considerable depth.. However, in some 
cases, such as for sensor articulation complexity or the number 
of views required, differences exist where an analytic solution 
is not possible since the requirements may be strongly influenced 
by the operator f s performance using the monoscopic or stereoscopic 
systems. For example, a stereovisual system may be equivalent 
to two monovisual views. Therefore, the following analysis places 
primary emphasis on the sensor, illumination, display, • and tele- 
communication subsystems and identifies specific areas where man- 
in-the-loop simulations are required. To reduce the number of 
stereo candidates required in a simulation program, the use of a 
fresnel or lenticular display must also be established. 


A. SENSORS 


Television cameras are the primary sensors used in the three pre- 
ferred candidate visual systems. Failure of the sensor subsystem 
will result in termination of the mission and, in the event the 
visual system is used as a navigational aid, probable loss of the 
FFTO. Thus, the quality of the sensor subsystem is an important 
parameter to optimize. 

1. State-of-the-Art TV Cameras 

Television cameras have been used in space since the very early 
days of orbiting satellites. A number of good, space-qualified 
cameras have been developed since that time. Methods have been 
devised to produce color and stereo pictures, some on a near-real- 
time basis. Cameras for use in manned missions have generally 
employed the 525-line, 30-f rame-per-second format for compatibility 
with National Television Standards Committee (NTSC) standards for 
commercial broadcasts. The NTSC format is generally accepted for 
producing a display with adequate resolution, motion rendition, 
and realistic color, saturation, and hue. A listing of space- 
qualified, NTSC-compatible cameras through the 1975 time frame 
is given in Table VII-1. 
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Table VII- 1 Space- Qualified * NTSC-Compatible TV Cameras 



WTC-13 

Military 

Aircraft 

4.5 MHz 

350 lines 

1-in. (2.54-cm) 
SEC Vidicon 

1 ft-c (10.8 
lux) at 32 db 

1000:1 


20 w 

11 lb 
5.00 kg) 

. Westinghouse 
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Note that all the TV cameras listed in the table are color cameras. 
Analyses and simulations will be performed later during this study 
to determine if color is a necessary parameter for FFTO tasks. In 
the event that monochrome emerges as the preferred system, each of 
the color cameras can be converted to monochrome by a simple mod- 
ification — removing the color wheel and motor. The primary bene- 
fits of this modification are the ten— fold increase in sensitivity, 
coupled with a small decrease in weight and power. 

The earlier Apollo color cameras were easily damaged when pointed 
directly at the sun or specularly reflected sunlight; the curtailed 
coverage of the Apollo 12 moonwalk is a graphic example. A new 
burn-free silicon target for the camera was subsequently developed 
to prevent such problems. All of the later Apollo cameras and 
the camera developed for Skylab have similar characteristics and 
are basically acceptable for the sensor subsystem. The RCA Apollo 
15/16 lunar surface cameras require somewhat less power (12.8 w, 
as opposed to 16-21 w) , and the NASA/Lockheed camera, presently 
under development, combines low power and much lower weight, but 
suffers from a lack of sensitivity. 

2. Developmental TV Cameras 

With the exception of the NASA/Lockheed camera, the discussion 
thus far has centered around space-qualified TV cameras that are 
in the "off-the-shelf" category. This approach leads to the low- 
est-risk, lowest-cost development. However, new types of sensors 
under development offer superior performance in some areas, par- 
ticularly if a color system is required. State-of-the-art devel- 
opment presently centers around three new sensors: (1) silicon 

photosensor arrays; (2) charge-coupled devices; and (3) crossed- 
stripe vidicons. These devices are discussed below. 

a. Silicon Photosensor Arrays - Silicon photosensor arrays can 
be constructed using either photodiodes or phototransistors. The 
individual devices are integrated onto a single wafer arranged 
in a rectangular, addressable matrix. Westinghouse has produced 
an array of up to 400 by 500 elements. 

The sensitivity of such an array is roughly equivalent to that of 
a standard vidicon. It is extremely linear because each element 
is the same size, has the same center-to-center spacing, and is 
addressed digitally. The most serious drawback to a sensor of 
this type is the inability to manufacture a flaw-free wafer with 
present technology. Defects may cause certain spots or lines to 
appear either light or dark, and picture details in the affected 
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areas will thus be obscured. In small production runs, about 10/o 
of the elements in each wafer will normally be defective. To date 
no large-area array has been produced free of defects. Large runs 
with improved techniques may allow selection of a small number of 
flawless arrays, but this procedure is expensive. As a result, 
it is doubtful whether silicon photosensors can be relied on for 
use during early Shuttle missions. 

b* Change-Coupled Devices - A recent development that shows great 
future potential is the charge-coupled device (CCD) . The CCD con- 
sists of a silicon substrate insulated from tungsten electrodes 
by a thin layer of silicon dioxide. Light impinging on the sub- 
strate is converted into a charge that is stored in potential 
wells. The magnitude of the charge depends on the number of pho- 
tons hitting the surface. Voltages applied to the electrodes move 
these charged potential wells through the substrate, where they are 
"dumped" into a register, producing an analog output signal. 

The primary advantages of the CCD over silicon photodiode arrays 
is in their simplicity of manufacture: the CCD needs no diffusions 

into the silicon substrate to form image elements, whereas the 
diode array can require up to several hundred thousand diffusions. 
Thus, the yield for CCDs and the probability of a perfect wafer 
are much higher. In addition, the CCD is more sensitive than even 
the intensifier vidicon, and more linear since a deflected beam 
is not required and the readout is digitally clocked. Moreover, 
simple, conventional circuitry is all that is needed to read out 
the array. 

The most serious drawback at this time is the relatively large 
size of the elements. To make an array large enough for commercial 
standard TV, the elemental area must be reduced. At the present 
time, the largest array is 128 by 106 elements, produced by Bell 
Laboratories. However, the potential value of CCDs as the ultimate 
replacement for vacuum tube sensors is so great that several large 
companies are pursuing aggressive research and development pro- 
grams, and the technology is advancing much more rapidly than that 
for other solid-state TV sensors. The charge-coupled device is, 
therefore, a potential candidate for a 1975 camera, whether color 
or monochromatic. 

a. Crossed- Stripe Vidioons - If color is a requirement, the cros- 
sed-stripe vidicon invented by RCA provides certain advantages 
over the rotating color wheel cameras currently available. This 
development utilizes two dichroic filters. One filter consists 
of alternating bands of a blue-reflecting surface and a clear 
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transparent surface and is placed in front of the vidicon sensor 
surface with the stripes vertical. A similar filter, which has 
alternate clear and red-stop stripes, is placed in front of the 
first filter with the stripes at a 45-deg (0.785-rad) angle to 
the vertical. Light that passes through the filter and reaches 
the vidicon target is scanned in a normal fashion. The output 
signal contains the monochrome information as well as two sub- 
carriers, amplitude-modulated by the red and blue information. 

The color signals may be stripped off and remodulated as a com- 
patible NTSC signal for transmission to the ground. The signal 
can also be reprocessed for viewing on an onboard color or mono- 
chrome monitor without the flicker problem that occurs with the 
field-sequential Apollo color cameras. 

Because the cross-stripe camera makes use of a single vidicon 
tube and does not require a motor or color wheel, it can be po- 
tentially lighter and may consume less power than present Apollo 
cameras. The same type of SIT tube now in use can be adapted to 
the cross-stripe method. The tube must, however, be of very high 
quality; i.e., it must have low noise and uniform resolution, and 
the deflection must be extremely linear. 

The above developments represent some of the techniques that may 
be applicable in 1975. Although each represents some desirable 
features unavailable in present cameras, there is an attendant 
risk in specifying any of these devices now. 

3. TV Camera Sensor Summary 

The visual system sensors will, in all likelihood, be selected 
from or be typical to those identified in Table VII-1. The basic 
differences between the sensor subsystems for the monoscopic and 
stereo visual candidates are summarized in Table VII-2. Note 
that these differences relate only to a single sensor package, 
since either candidate system may require more than one view. 


Table VII-2 Sensor Differences between Candidate Systems 


System 

Parameter* 

Monoscopic System 

Stereo-Fresnel System 

Bandwidth 

5 MHz 

10 MHz 

Power 

12 w 

24 w 

Weight 

2.8 kg (6.2 lb) 

5.6 kg (12.4 lb) 

Size 

8.2 x 13.1 x 24.1 cm 

16.5 x 13.1 x 24.1 cm 

(Width x Height x Depth) 

(3.25 x 5.2 x 9.5 in.) 

(6.5 x 5.2 x 9.5 in.) 

*Based on the NASA/Lockheed camera. 
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4. 


Sensor Aids 


The variety and number of possible FFTO tasks may place certain 
requirements on the weight, location, and mobility of the visual 
system sensors. Operating the manipulator within a confined or 
partially enclosed volume might require a visual sensor very near 
the end-effector of the manipulator arm, whereas the weight and 
volume of the TV camera might make the requirement seem impractical 
or impossible. The following paragraphs describe some methods 
that could help alleviate such problems. 

a. Arm-Mounted Mirrors - One popular concept for providing around- 
the-corner vision of objects from a camera fixed on the body of 
the teleoperator is to use a mirror or mirrors mounted at the de- 
sired points on a manipulator arm. This concept can become quite 
complex, depending on the motion of the arm. If more than one 
mirror is used or if the mirror must track the end-effector, some 
mechanism must be employed to rotate the mirror at half the ro- 
tation rate of the elbow or wrist joint in the manipulator arm. 
Also, the mirrors must be kept small in order to achieve the de- 
sired reduction in weight and volume, which imposes narrow field- 
of-view restrictions. 

b. Fibpr-Optic Bundles - An alternative method would employ a 
flexible fiber-optic bundle to relay the image from the end-ef- 
fector to the faceplate of the camera. The use of fiber-optics 
bundles to transport images is an attractive concept for possible 
application to a teleoperator visual system sensor package. A 
coherent fiber-optic bundle or light pipe could be used to elim- 
inate the need for heavy cameras at or near the end-effector of a 
manipulator arm since the image could be transported to a camera 
inside the body of the FFTO. A coherent light pipe capable of 
achieving this without degrading a standard TV image would require 
about 300,000 fibers and be approximately 1% to 2 in. (3.81 to 
5.08 cm) in diameter. A cable this size would have a bend radius 
of 5 to 6 in. (12.7 to 15.2 cm), and at present, .would cost about 
$6,000 for a 12-ft (3.67-m) length. 

An important parameter in considering fiber optics for FFTO ap- 
plications is the transmissivity of the fiber material. Corning 
Glass Works and Bell Laboratories have made significant progress 
in developing extremely low-loss [60% loss/km (60% loss/3281 ft)] 
optical waveguides for use in data handling and communications, 
but these waveguides are undesirable for coherent fiber-optic 
bundles due to their low usable cross-sectional area. 
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As shown in Fig. VII-l the cladding around each fiber constitutes 
about 65% of the total cross-sectional area for Corning low-loss 
material. If light were imaged on a bundle of such fibers, 65% 
would be lost on the cladding and an additional 15% would be lost 
between fibers. Also, an anticipated 5% of the light would be 
lost upon entry into the waveguides, leaving no more than 10 to 
15% of the light to be transmitted through the fiber-optic bundle 
to the TV sensor. 

Higher-loss optical waveguides [20% loss/meter (20% loss/3.28 ft)] 
are available with minimal cladding, and are most often used to 
transport images across short distances. Again, nearly 15 to 20% 
of the light will be lost between fibers and upon entry into the 
fibers, but in this case the minimal cladding allows some 80-85% 
of the incident light to enter the fiber-optic bundle (considerably 
more than with low-loss waveguides) . If this higher-loss optical 
waveguide is used over distances beyond 7.6 m (25 ft), its in- 
creased cross-section advantage is nullified by absorption, and 
again less than 10-15% of the incident light will reach the TV 
sensor. Figure VII-2 shows the percent transmitt ivity as a func- 
tion of distance for the two waveguides. 

In summary, methods are available to reduce the mass and volume of 
the visual system sensor package located on the manipulator arm. 
Unless the weight and volume requirements are very critical, 
however, the increased complexity should be avoided. A simple 
TV camera operating without optical relays or mirrors provides 
an optimum output with minimum complexity. 


B . ILLUMINATION 


An analysis of the photometric parameters of the sensor subsystem 
must consider sensor sensitivity, ambient lighting, artificial 
lighting, size of target, and target reflectivity. A list of 
various space-qualified TV cameras and their corresponding sen- 
sitivities is shown in Table VII-3. 
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Lost Illumination Areas 


Fig . VII- 1 Cross-Sectional Diagram of Cormng 
Low-Loss Optical Waveguides 



Distance, m 


Distance, ft 

Fig • VII- 2 Percent Transmissivity vs Distance for Standard and Low-Loss 
Optical Waveguides (Entry Losses Included) 







Table VII-3 Sensitivity of Various Space- Qualified TV Cameras 


Camera 

Sensitivity, ft-c (lux) 

Apollo Color (RCA) 

3 (32.3) 

Apollo Color (Westinghouse) 

1 (10.8) 

NASA/Lockheed Color 

50 (538) 

NASA/Lockheed Monochrome 

4 (43.1) 

ATS AVCS — Shuttered Vidicon 

0.1 (1.08) 

High Resolution [11.4-cm 
(4.5-in.)] Beam-Return Vidicon 

0.01 (0.1) (assumes 10-msec 
exposure) 

Apollo Black and White 
(Westinghouse) 

0.003 (0.03) 


The sensitivities listed above are numerically equivalent to the 
required brightness of the target in f oot-lamberts regardless 
of target distance. 

The brightness of the target surface in foot-lamberts is given 
by 



where 

R = Reflectivity of target surface, 

•e = Total luminous flux emanating through 
4ir steradians, in lumens, 

A = Area illuminated, in square feet 

C = Spherical candlepower of source, in candles. 

The intensity is then given by 
BA 


C = 


4ttR 


candles 


or 


BA . 

e = — lumens. 
K 
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Assuming a target reflectivity of 70% and the worst camera sen- 
sitivity of 50 ft-c (538 lux), the required source intensity is 

r - BA 50 ft-lamberts ... 

L " 4irR (0.7) 4tt w 

=5.7 ft-lamberts x (A) 

= 19.5 Cd/m 2 x (A) 

If all the available light is confined to a 44-deg (0.768-rad) 
field (a solid angle of % 0.6 sr) , then A is equivalent to the 
square of the source-to-target distance, D, times the solid angle, 
or 

A = (0.6) D 2 , 
and C becomes 

C = (5.7 ft-lamberts) (0.6) (d 2 ) 

= (3.4 ft-lamberts) (d 2 ) 

= 11.6 Cd/m 2 x (D 2 ) 

Therefore, a source intensity of 1.36 x 10 3 candles (1.7 x 10 1 * 
lumens) would be required to sufficiently illuminate a 44-deg 
(0.768-rad) field at a range of 20 ft (6.1 m) for detection by 
the NASA/Lockheed color camera. This figure is 25% higher than 
the specified brightness requirement of 40 ft-lamberts (137 
Cd/m 2 ) at the base of the working volume. 

Figure VII-3 is a graph of source intensity vs source-to-target 
distance for the cameras listed earlier. Again, the total il- 
lumination is confined to a 44-deg (0.768-rad) field. As can be 
seen, the NASA/Lockheed camera, as presently configured, requires 
nearly 20 times as much target illumination as the RCA Apollo 
camera. The added weight and power of the lighting equipment may 
negate the weight and power savings of that camera. Compare the 
curve of the NASA/Lockheed color camera with the same unit mod- 
ified for monochrome operation (the NASA/Lockheed black and white 
camera). The sensitivity is considerably greater so that 10 times 
less candlepower is needed for the same picture signal-to-noise 
ratio. 
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1 . 


Artificial Lighting 


The amount of electrical power required to produce the source 
intensities derived above depends on the type and efficiency of 
the lamp used. The tungsten-halogen cycle spotlights are limited 
to approximately 22 lumens (1.75 candles) per watt of electrical 
power, but these lamps emanate from a small point and can there- 
fore be easily focused into a desired configuration. At present, 
tungsten- halogen .and stroboscopic lamps are the only lamps avail- 
able that can perform in a hard space environment. 

If mission requirements dictate the use of continuous or near- 
continuous artificial illumination, then development and quali- 
fication of a cold-cathode fluorescent lamp should be. considered. 
Spectral matching of fluorescent lamps can provide efficiencies 
of up to 100 lumens (8.0 candles) per watt of electrical power, 
and the lamps can easily be matched spectrally with the chosen 
sensor in order to attain maximum sensor output for the input 
power of a given lamp. Furthermore, the cold-cathode fluorescent 
lamps emanate from the outer surface of a glass tube and conse- 
quently provide a more diffuse lighting field than tungsten lamps. 
The fluorescents are, therefore, better suited to area illumination 
where soft shadows are desired. 

Figure VII-4 shows the electrical power required by various lamps 
to illuminate a 70% reflective target to a brightness of 40 ft- 
lamberts (137 candles/m 2 ) as a function of the source-to-targett 
distance, assuming a 44-deg (0.768-rrad) illumination field. Since 
the tungsten-halogen cycle lamps are highly developed and lend 
themselves to high-illumination spotlighting, they are recommended 
for all necessary teleoperator artificial lighting requirements. 

A number of techniques can be implemented to soften the shadows 
and control the beam direction and spread from these lamps. One 
effective method for providing diffuse illumination over a con- 
trolled field is to use a fly-eye type lens in front of the lamp. 
This technique makes the source appear as a. two-dimensional array 
of small spotlights, all illuminating the desired object field 
from a slightly different angle. The result is softer shadows 
with high spotlight efficiency. 
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Other common artificial lighting options include the use of 
fresnel lenses for concentrated spot lighting, cylindrical and 
spherical reflectors to improve directivity and efficiency, and 
ground-glass type diffusers for softening shadows. In addition, 
movable reflectors and fresnel-type lenses could be incorporated 
into a "zoom" lighting system for variable concentration of il- 
lumination. The design of such a system must be given further 
consideration to determine changes in the lamp efficiency. 

2. Passive Lighting 

An important concept to consider in a discussion of object illu- 
mination is the use of passive lighting devices designed to re- 
flect existing light into the object. Passive lighting devices 
could greatly reduce the requirement for artificial lighting in 
situations where sunlight is incident on or near the sensor sub- 
system. Some of the different passive lighting techniques that 
could be used for teleoperator applications are discussed in the 
following paragraphs. 

a. Flat Mirrors - The most obvious form of passive lighting is 
to use flat mirrors to direct existing sunlight onto the desired 
object or area. This method provides very bright illumination 
and hard, sharp shadows identical to those observed with direct 
sunlight. The area illuminated is limited by the size and orien- 
tation of the mirror-, but attendant servo systems would enable 
mirrors to track the sun and direct the illumination where re- 
quired. 

If considerable time is to be spent viewing a specific small area, 
the flat mirror and servo system may be desirable. If a broader, 
but slightly less intense illumination field is desired, the flat 
mirror could be replaced with a convex mirror or convex mirror 
array, but a tracking system would still be required. A diffuse 
or specular reflecting sphere mounted adjacent to the sensor 
would provide reflected light through a wide range of incident 
angles and would not require a servo system of any sort. This 
technique could be used in combination with artificial lighting, 
as shown in Fig. VII-5, to provide minimal power usage and max- 
imum versatility. 
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Fig. VII- 5 Combined Passive and Active Lighting Scheme 

b. Shading Techniques - Another technique for improving object 
illumination and reducing contrast and hard shadows is that of 
shading the object from direct sunlight# An opaque shield would 
block direct sunlight so that the methods described above could 
be used effectivelyi but a more logical approach would be to use 
a transmitting diffuser or fly T s-eye lens that would convert 
direct sunlight into a diffuse and less intense illumination field • 
Shading techniques, like flat mirrors, would require attendant 
servo systems for position control. 

Highly diffuse lighting techniques (i.e., ground glass or dif- 
fuser reflection) and shading techniques are relatively ineffective 
for object distances beyond 6.1 m (20 ft). Spotlighting tech- 
niques are more suitable for illuminating distant objects. 

3. Summary 

Illumination requirements are independent of the number of cameras 
viewing the scene. The lighting techniques discussed in the pre- 
ceding paragraphs perform identically for both stereoscopic and 
monoscopic sensor subsystems, provided a particular camera is 
specified. 

If the low-sensitivity NASA/Lockheed color camera Is used to view 
an adequately illuminated 44-deg (0.768-rad) field at 6.1 m (20 ft), 
then about 775 w of electrical power are required to illuminate 
the scene with a concentrated tungsten-halogen lamp. If the same 
camera is modified for monochrome operation, then only 62 w of 
electrical power are required. These figures represent an approxi- 
mate upper limit on power consumption for artificial lighting. 
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DISPLAYS 


The most significant analytical task required in considering the 
candidate system displays is to eliminate one of the stereo dis- 
play systems. Both the fresnel and lenticular displays can be 
designed for identical TV sensors and sensor subsystem require- 
ments, including (1) single-camera, split-field imaging, (2) dual- 
camera, split-field imaging and (3) dual-camera, electronic time- 
sharing. Both systems can use small, low-power-consumption dis- 
play monitors that optically magnify the field of view to yield 
the desired image dimensions, and their bandwidth, power consump- 
tion, and resolution specifications are nearly equal. The primary 
differences between them lie in the region between the display 
monitor tubes and the display screen. The following analysis of 
the two display systems describes those differences and their ef- 
fect on complexity and performance. 

Fresnel Display Characteristics 

The components of the fresnel display are diagrammed in Fig. VII-6. 
Display tube R contains the right camera image and display tube L 
contains the left camera image. Each display tube is projected 
along its own optical axis through a .separate transfer lens 

or onto the fresnel screen (F) such that the perimeters 

of the display tube coincide on the face of the display. The 
fresnel display screen acts as a field lens and directs the light 
from the right and left images to the corresponding eyes of the 
viewer. 


Fresnel Display Screen 



Fig . VII-6 Fresnel Display Components 



Many of the display system parameters are defined or limited by 
the display’s basic theory of operation. These parameters are 
discussed in the following paragraphs. 

a. Resolution - The resolution of the fresnel display can be in- 
fluenced by the display tubes (monitors), the transfer lenses, or 
the eyes of the viewer. For the FFTO, it is certain that the dis- 
display tubes, being raster scan- type TV monitors, will limit the 
resolution of the display system. The human eye and an off-the- 
shelf transfer lens are' both capable of much higher resolution 
than state-of-the-art TV monitors. Since the display image is 
projected in the plane of the fresnel field lens, this lens has 
little or no influence on the resolution of the display: its 
performance influences only the definition of the viewing field 
(exit pupil) of the display. 

b . Illumination Efficiency - The fresnel stereoscopic display 
has an inherently high illumination efficiency as a result of 
its basic design. As with any projected display, much of the 
light emanating from the display tube or monitor is collected by 
the transfer lens and projected onto the display screen. Conven- 
tional display screens (ground glass, liquid crystals, etc) then 
diffuse the projected light over a wide field (often nearly 2tt sr) 
so that very little illumination is collected by the viewer’s eye. 
In comparison, the fresnel field lens or display screen collects 
all the image illumination incident on its surface and directs 
that illumination into an area of about 100 sq cm (15.5 sq in.) — 
corresponding to a solid angle of Sr 0.03 sr — at a distance of 

46 to 61 cm (18 to 24 in.) from the face of the display. This 
represents more than a hundred-fold improvement over the effici- 
ency of a diffuse screen. 

c . Display Size - The size of the fresnel display screen is also 
limited by the design of the display subsystem. Since a standard 
fresnel field lens will not perform at lens speeds faster than 
about f/1.5 at unit magnification (object and image distance equal 
to two focal lengths) , the diameter is limited to approximately 
one-third of the viewer- to-display distance. Thus, a fresnel dis- 
play for the FFTO would be limited to about 20.3 cm (8 in.). This 
has been demonstrated in laboratory bench tests at Martin Marietta. 
It is quite possible that a custom-designed fresnel lens could in- 
crease this limit to 30.5 cm (12 in.). 

d . Head Movement - Restriction of head movement is the big draw- 
back of the fresnel stereoscopic display. If glasses or headgear 
are to be avoided, the right and left images must be projected 
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into separate zones in space. Otherwise there is no facility for 
separating the stereo images.. Depending on the design details of 
the display subsystem and on the size and shape of the transfer 
lenses, the allowable horizontal head movement for stereoscopic 
vision could range from nearly zero to 6.4 cm (2.5 in.) , the lat— 
ter limit being dictated by the human interpupillary distance. 
Vertical head movement could be as much as 15.2 cm (6 in.), and 
forward head movement, as much as 0.6 m C 2 ft). 

a. Hardware Alignment Criteria - Due to the simple and straight- 
forward projection methods used in the fresnel display, alignment 
tolerances are dictated only by the viewer’s ability to obtain 
proper stereo registration between the two images, and are there- 
fore quite relaxed. The actual tolerances must be measured sub- 
jectively. 

/, Display Acquisition - Due to the small degree of allowable 
head movement inherent in the design, it is more difficult to ac- 
quire the fresnel stereo display than conventional monoscopic dis- 
plays. No image can be seen on the display screen unless the 
viewer’s eyes are within the allowable head movement volume speci- 
fied earlier. However, bench tests at Martin Marietta have shown 
that acquisition of the fresnel display, though somewhat critical 
in its viewer position requirements, is almost instantaneous, even 
for persons with minimal training. Consequently, the disadvantage 
in this display is not the relative difficulty of acquisition, but 
the inability to view the display at oblique angles to the screen. 

g . Ambient Light - The high illumination efficiency of the fresnel 
display ideally suits it to use in high ambient lighting conditions. 
Display brightness is excellent, as was explained earlier, but re- 
flections off the face of the fresnel screen must not be ignored. 

The concentric grooves in the screen give rise to radial reflec- 
tions that can be very disturbing. These should be eliminated by 
using a circularly polarized cover plate (often found on standard 
TV screens) or antireflection coatings on the display surface. 

2 . Lenticular Display Characteristics 


The components of the lenticular display are diagrammed in Fig. 
VII-7. Display tube R contains the right camera image and dis- 
play tube L contains the left camera image. Each display image 
is divided into narrow strips by a Ronchi ruling or mixing grid 
of alternating opaque and transparent vertical lines. A beam- 
splitter is used to interlace the right and left image strips 
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and to bring them onto a common optical axis. The interlaced 
images are then projected through a transfer lens onto a lenti- 
cular faceplate with a diffuse backing so that a right and left 
image strip pair falls precisely behind each lenticule. The 
lenticules then direct the right image strips into the right eye 
zone and the left image strips onto the left eye zone so that the 
display strips can be viewed in stereo. Again, many of the dis- 
play system parameters are defined or limited by the display’s 
basic theory of operation. These parameters are discussed below. 

a. Resolution - The resolution of a lenticular display is limited 
by the spacing of the lenticular grid or the resolution of the image 
introduced into the display. For example, if the frequency of 

the lenticular screen exceeds the line frequency of the image ly- 
ing immediately behind the screen, the effective resolution of 
the display cannot be improved by improving the lenticular screen. 

Figure VII-8 shows a plot of display resolution vs lenticular grid 
frequency for a standard 525-line, twin-camera TV system. When 
the grid spacing is matched to the TV line spacing of the image, 
the display is optimized. Any reduction in the line frequency of 
the lenticular grid will cause a linear reduction in the resolu- 
tion of the display, but an increase in the line frequency will 
yield little or no improvement. 

b . Illumination Effioienty - The lenticular display employs a 
diffuse surface at the image plane, resulting in an illumination 
efficiency similar to that of a back-projected monoscopic system. 

It could be argued that 50% of the light is lost immediately upon 
striking the mixing grids, but in a TV application the monitor 
could be rotated so that the scan lines are vertical and sepa- 
rated by dark areas. If the extremely critical linearity require- 
ments are met, these dark areas could eliminate the need for ad- 
ditional grids and all of the light would be projected into the 
beamsplitter. 

At the beamsplitter at least 50% of the incident light will be 
lost, so at best the illumination incident on the display screen 
will be one-half that incident on the screen of a monoscopic dis- 
play. The directivity of the lenticular screen may compensate 
for the beamsplitter loss in on-axis viewing, but off-axis illumi- 
nation would be reduced. 

c. Display Size - Theoretically, there is no sharp-design cut- 
off limiting the size of a lenticular display. Scientists at 
the University of Illinois claim to have developed a 15.3-cm 
(6-in.) lenticular display by using a custom-built TV monitor and 
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Fig. VII-7 Lenticular Display Components 
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Fig. VII-8 Lenticular Display Resolution vs Lenticular 
Grid Spacing 


VII-20 





electronic interlacing of images. Martin Marietta is not aware 
of any larger lenticular displays and suspect that somewhere 
around 15.3 cm (6 in.) is a practical limit. 

d . Head Movement - Computing the allowable head movement for a 
typical lenticular display system is fairly complex due to the 
large number of optical parameters involved. However, the use 
of television as the image-forming media limits the parameters 
to a point where the basic capabilities of the system can be de- 
scribed. 

Consider the diagram shown in Fig. VII-9. where the TV image 
plane is made up of alternating right and left image elements 
that have been interlaced either optically or electronically. 
Assuming that the image elements are spaced such that one image 
element pair has the same dimension as a single lenticular lens 
element, each image element pair will have an identical geomet- 
rical projection through its corresponding lenticular lens ele- 
ment. This allows one to view the display in stereo as long as 
the left eye remains in the left-element viewing angle and the 
right eye remains in the right-element viewing angle. Conse- 
quently, at any given instant the viewer can see stereo over an 
image format no wider than his interpup illary dimension. As he 
moves his head sideways, the area of the display in which he sees 
stereo also moves sideways. This situation is undesirable for 
the FFTO application since only a small percentage of the avail- 
able stereo information is used at any given time. If a display 
width of 6.6 cm (2.6 in.) is satisfactory, little or no informa- 
tion is wasted and the head is limited in horizontal movement to 
approximately ±3.3 cm (±1.3 in.). 

Since a larger display is required, a similar but alternative 
approach can be taken, as is shown in Fig. VII-10. In this case, 
the dimension of each image element pair is slightly larger than 
the width of a lenticular lens element. This increases the ob- 
liquity of the image element projection angle as a function of 
the distance from the center of the display screen, resulting in 
the formation of a horizontal M exit pupil" for each eye. Again, 
horizontal head motion is limited to approximately ±3.3 cm (±1.3 
in.), but a larger display can be viewed. If the head is moved 
further horizontally, a double monoscopic image will appear on 
the display. Characteristically, lenticular displays do, in fact 
allow considerable vertical head motion while viewing the stereo 
image. Head movement normal to the screen could be as much as 
0 . 3 to 0 . 61 m (1 to 2 ft) for stereo. Greater viewing distances 
will result in single- or double-image monoscopic viewing, depend 
ing on the position of the viewer. 
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Fig. VI.I-9 Image Element Pair Equal to Lenticular 
Lens Element 
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e . Hardware Alignment Criteria - Hardware alignment is extremely 
critical in the lenticular stereo display for many reasons. First, 
if picture resolution * is to be maintained, each line pair from the 
Ronchi rulings used to divide the picture into strips must have 
smaller dimensions than one resolution element of the original pic- 
ture. The two pictures must then be interlaced with an accuracy of 
approximately 10% of the strip width to obtain good stereo separa- 
tion. 


This means that a 15.3-cm (6-in.), 488-line display imaged at unit 
magnification would require a lateral^grating position and stabil- 
ity tolerance of less than ±1.5 x 10 cm (±6.1 x 10 in.) since 


Display Size 
Total Lines X 


10% = ±1.5 x 10 


cm. 


Likewise, a rotational tolerance of less than 18 arc-sec (0.0001 
rad) would be required for the same system. The position and 
stability of the lenticular faceplate must also satisfy these 
same tolerances. A second set of alignment tolerances arises 
from the finite depth of focus or depth of field of the projec- 
tion lens. If the image strips are not sharply in focus on the 
diffuse back surface of the faceplate, the strips will overlap 
and a double monoscopic image will result. For unit magnifica- 
tion, the^depth of focus (image side of lens) and depth of field 
(object side of lens) are identical. To avoid redundancy, depth 
of focus will be discussed with the understanding that the same 
analysis applies to the object side of the lens for unit magnifi- 
cation. 


The concept of depth of focus rests on the assumption that, for 
a given optical system, defocusing will produce a blur so small 
that it will not adversely affect the performance of the system. 
The depth of focus is the amount by which the image may be shifted 
longitudinally with respect to some reference plane (e.g., the 
lenticular faceplate) and introduce no more than the acceptable 
blur. The size of the acceptable blur may be specified as the 
linear diameter of the blur spot or as an angular subtense of the 
blur spot from the lens. Thus, the linear and angular blurs (B 
and 6, respectively) and the distance D from the object are re- 
lated by 8 = B/D for a system in air. 

From Fig. VII-11, it can be seen that the depth of field for a 
system with a clear aperture A can be given by the relationship 

* = i> 2 e 

(A ± 3D) ' 
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Aperture of 
Optical System 



When (3 is small the denominator simply becomes A. 

Let us assume that we have a 15,3-cm (6-in.) display and a trans- 
fer lens with a focal length of 15.3 cm (6 in.) operating at f/4. 
For unit magnification, D = 30.6 cm (12 in.), A = 3.8 cm (1.5 in.), 
and 3 = B/D. Again we will take B, the acceptable linear blur, to 
be 10% of the width of an image strip. We then have 

B = - = 4,9 x 10 5 rad 

and 


6 = = 1.2 x 10 ^ cm (4.7 x 10 ^ in.). 

A 

This means that both the display tube and the lenticular face- 
plate must be positioned and stabilized to the above tolerance 
along the z-axis (optical axis) . 

It is possible that these tolerances could be relaxed by a factor 
of 2 or 3, but some image degradation would result. 

f. Display Acquisition - A brief discussion of the ease of ac- 
quisition of the lenticular display is difficult. The display 
image is visible from oblique angles but may appear double, dis- 
continuous, monoscopic, pseudoscopic (with depth reversal), or 
true stereo, depending on the viewer’s distance and angle to the 
screen. The ease of acquisition of the display in the proper 
viewing zones for stereoscopic vision is theoretically the same 
as for the fresnel display in the horizontal and forward direc- 
tions, and is essentially unlimited in the vertical direction. 
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g. Ambient Light - Surface reflection of ambient light off the 
face of the lenticular display is minimal. If desired, that 
which does exist could be eliminated with antireflection coatings. 

A tabular comparison of the lenticular and fresnel stereoscopic 
displays (Table VII-4) indicates that, with the exception of al- 
lowable vertical head movement, the fresnel stereo display is equal 
or superior to the lenticular display: its illumination effici- 

ency is much higher than that of the lenticular display, and sys- 
tem alignment is not critical or difficult. 


Table VII-4 Analytical Comparison of Lenticular and Fresnel 
Stereo Displays 


Parameter 

Fresnel Display 

Lenticular Display 

Resolution 

Limited by TV system 

Limited by TV system or 
faceplate (see Fig. VII-9) 

Relative 

Illumination 

Efficiency 

1.0 

0.01 to 0.1 

Display Size 

Up to 30 cm (12 in.) 

Up to 15 cm (6 in.) 

Maximum 
Allowable Head 
Movement 



Horizontal 

±3.3 cm (±1.3 in.) 

±3.3 cm (±1.3 in.) 

Vertical 

±7.6 cm (±3 in.) 

Unlimited 

Forward 

±25.4 cm (±10 in.) 

±25.4 cm (±10 in.) 

Optical System 
Alignment 

Comparable to mono- 
scopic 

Critical (see text) 

Stereo Display 
Acquisition 

Almost instantaneous 
with minimal training 

Almost instantaneous 
( with minimal training 

Reflected 
Ambient Light 

Antireflection coating 
desirable 

Negligible 
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3. 


Display Evaluations 


To further evaluate the weak and strong points of the two display 
concepts, a bench setup of each was constructed for subjective 
evaluation. In addition, a back-projected monoscopic display was 
assembled for comparison. Identical 35-mm transparencies were 
used as inputs to the displays. 

The fresnel stereoscopic and back-projected monoscopic displays 
were easily and quickly assembled and aligned. The lenticular 
display proved much more difficult to align, as the analysis had 
indicated; and even after it was successfully aligned, periodic 
fine adjustments were necessary. Because of these inherent align- 
ment problems, the size of the display screen was limited to ap- 
proximately 7.6 cm (3 in.). For a proper subjective comparison, 
the other two display screens also had to be limited to 7.6 cm 
(3 in.). The back-projected monoscopic display and the stereo- 
scopic display are shown in Fig. VII’-12 and VII~13, respectively. 
The lenticular display and a close-up of the imaging optics are 
shown in Fig. VII-14 and VII-15. 

Figure VII-16 shows the three displays placed adjacent to each 
other for subjective evaluation. Allowable head movement and 
viewing distance were measured and recorded for a number of sub- 
jects using the apparatus shown in Fig. V 11-17, and each subject 
was asked to express his personal display preference. 

As shown in Table VII-5, the lenticular display had a very slight 
advantage. Personal preference, however, strongly favored the 
fresnel display for comfort, ease of viewing, and stereo acqui- 
sition. Furthermore, it was demonstrated that an optional dif- 
fuse screen placed over the face of the fresnel display would 
provide continuous monoscopic viewing of the display from even 
oblique angles, provided that one of the transparencies was 
blocked. 

Note that in a TV system, single-channel operation could be 
achieved by simply switching off one monitor. The diffuse screen 
would then provide continuous monoscopic viewing with reduced 
display brightness for one or more persons simultaneously. This 
option would also affect the redundancy of the visual system. 
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Fig. VII- 12 Back-Projected Monosaopic Display 


Fig. VII-1S Fresnel Stereoscopic Display 
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Fig. VII-17 Display Evaluation Setup 
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Table VII-5 Bench Test Results 



Fresnel Display 

Lenticular Display 

Horizontal at 53 cm 
(21 in.) Range 

±0.76 cm 
(±0.3 in.) 

±2.0 cm 
(±0.8 in.) 

Vertical at 53 cm. 
(21 in.) Range 

±1.27 cm 
(±0.5 in.) 

±20.3 cm 
(±8 in.) 

Viewing Distance 

.41 to 107 cm 
(16 to 42 in.) 

25 to 91 cm 
(10 to 36 in.) 

*These measurements were made with actual laboratory bread- 
board displays. These figures do not represent practical 
limits. 


In light of the alignment difficulties encountered with the lenti- 
cular display and the subjective preference for the fresnel dis- 
play, all subsequent analyses and simulations will be based on 
the use of a fresnel stereoscopic display subsystem. However, if 
the requirement arises for two operators to simultaneously view 
the stereo display, the lenticular display concept will be re- 
evaluated, based on its theoretical multiple-viewer capability. 


D. TV MONITORS 


In the past, there has been little need for onboard visual display 
of TV camera video. In fact, the 7.6-cm (3-in.) f, Mini-Monitor ," a 
small monochrome companion unit to the Westinghouse Apollo Command 
Module cameras, is the only unit that has been used on manned mis- 
sions to date. This monitor accepts a standard 525-iine, 60- 
field/sec , 2:1 interlace_v ideo with compos i te synchronization. It 
occupies a volume of 1390 cc (85 cu in.) and uses only 2.5 w of 
power. With suitable magnification, it should be acceptable for 
use with a fresnel-display , two-camera stereo system. (Recall 
that a stereo display concept . involving a projected image can 
employ TV monitors much smaller than the display screen, and, con- 
sequently, the monitors can be very light and compact.) 

The only other manrated TV monitor is the 15.8-kg (35-lb), 60-watt 
unit that will be used in 1973 on Sky lab. This monitor is a rounds 
15.2-cm (6-in.) monochrome unit that accepts standard video. How- 
ever, in this size range, it will be minimally suitable for direct 
viewing for FFTO applications. 
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If larger screens are required, a development program is inevi- 
table, However, a number of military-qualified airborne monitors 
could be upgraded at a minimum developmental risk. For example, 
the Conrac Model 3061600 — a 20.4-cm (8-in.), solid-state, mili- 
tarized, airborne video monitor--could be considered a candi- 
date. This unit is a rectangular monochrome monitor that weighs 
10.4 kg (23 lb) and uses about 100 w. Its overall dimensions 
(including connectors) are: width, 21.6 cm (8.5 in.); height, 

17.1 cm (6.75 in.); and depth, 40.5 cm (16 in.). In addition, 
25.4-cm (10-in.), 35.6-cm (14-in.), and 43.2-cm (17-in.) screen 
versions also exist. 

The monitors listed above are all monochrome. They may be used 
with either monochrome or color video. However, when displaying 
the output of a sequential camera, an undesirable feature will 
occur. For example, consider an Apollo color camera observing 
a satellite that has been painted white. The white paint con- 
tains the full visual spectrum, including the filter colors of 
the rotating color wheel in the TV camera. Thus, all three 
sequential frames — red, blue, and green — will "see" a light ob- 
ject; all three frames will look the same, and the monitor will 
display a good, flicker-free black-and-white picture. 

Next, assume the satellite is painted a deep red. Now the satel- 
lite will appear dark during the frames taken through the blue or 
green filters, and light during the frame when the red filter is 
placed in the optical path. Now the black and white monitor will 
display a picture in which the satellite appears dark tvvro-thirds 
of the time and light one-third of the time. The result will be 
an objectionable 10-Hz "flicker 11 on the monochrome monitor. 

Extending this effect, it can occur in any colored object under 
observation; and the deeper the color saturation, the more pro- 
nounced the "flicker." Scan conversion can be employed to "hold" 
and display only the scenes taken through a single filter, but 
the converter presents technical development problems that have 
not yet been solved for use in space. 

A color monitor has been under development for potential space 
use. The prototype 30.5-cm (12-in.) unit uses a "Trinitron" 
cathode ray tube to maximize resolution capabilities. Currently, 
the development has been halted after completion of the prototype 
and requires considerable additional work before it can be quali- 
fied. Without scan conversion, this monitor suffers from the same 
"flicker" problem as the monochrome types, except that the object 
will "flicker" in its proper color. An acceptable color picture 
without "flicker" could be produced without scan conversion by us- 
ing a simultaneous color camera such as the "crossed-stripe" 
camera discussed earlier. 
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Typical monitor characteristics for each type of display are shown 
in Table VII-6. 


Table VII-6 Typical Monitor Characteristics 


Parameter 

Mono* 

Stereo 

Number Required 

i 

2 

Monitor Size 

30.5 cm (12 in.) 

7.6 cm (3 in.) 

Power 

60 w 

1.6 w 

Volume 

27,000 cm 3 (1600 in. 3 ) 

1390 cm 3 (85 in. 3 ) 

Weight 

11.3 kg (25 lb) 

2.5 kg (5.4 lb) 

Monochrome 

State of the Art 

Space-Qualified 

Color 

Developmental 

Developmental 

*Assumes a 30-cm (12-in.) monitor is required to give a 
30-cm (12-in.) display because of light loss due to rear- 
projection techniques. 
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E. 


DEPLOYMENT/ARTICULATION 


The analysis of the deployinent/articulation subsystem, being pri- 
marily based on requirements for the FFTO working volume/working 
site, provides one of the most challenging problems associated with 
any visual subsystem, basically in two areas: (1) the number of 

views required and (2) the required location of these views (i.e., 
cameras). The first area is primarily task-dependent, while the 
second is based on optimizing operator performance. Both areas 
require man-in- the-loop simulations. However, some preliminary 
considerations are easily established analytically. 

General guidelines were provided in the statement of work relating 
to the operational coverage the visual system sensor must provide. 
These guidelines are: 

1) The system’s field of view (FOV) shall accommodate the working 
volume of the manipulators; 

2) The working volume and working site for the visual system are 
based on three typical applications of manipulative devices. 

The applications include using an FFTO for (a) satellite main- 
tenance (using a general-purpose manipulator) ; (b) satellite 
retrieval (using. a retrieval device); (c) satellite inspection. 

In support of these typical applications, further dimensional re- 
quirements were imposed. Satellite maintenance , as shown in Fig. 
VII-21, defines the working volume and the working site as fol- 
lows : 

1) Working Volume 

-1.22 <_ x £ 1.83 m (-4 £ x £ 6 ft) 

-1.83 £ y £ 1.83 m (-6 £ y £ 6 ft) 

-1.83 £ z £ 1.83 m (-6 £ z £ 6 ft) 

except for the volume occupied by the vehicle, which is de- 
fined by: 

-1.22 £ x £ 0 m (-4 £ x £ 0 ft) 

-0.92 <y< 0.92 m (-3 < y < 3 ft) 

-0.61 < z < 0.61 m (-2 < z < 2 ft) 
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2) Working Site 

- This shall be an area 1.22 m (4 ft) square located anywhere 
in the working volume, with its surface oriented perpendic- 
ular to the X-axis ± 20 deg (±0.349 rad). 

- The vehicle will be attached to the working site at three 
points. 

- Access to both sides of the surface is required. 

- The distance between the vehicle and site shall be 0.31 
£ x 5 1.83 m (1 £ x £ 6 ft). 

Figure VII-18 shows the dimensional constraints for satellite re- 
trieval. These are defined as follows: 

1) Working Volume 

0 _< x 6.1 m (0 £ x £ 20 ft) 

-7.6 j< y <_ 6.1 m (-25 £ y £ 20 ft) 

-7.6 < z < 6.1 m (-25 £ z £ 20 ft) 

2) Working Site 

- This shall be a circular area with a maximum diameter of 
4.6 m (15 ft), located anywhere within the working volume, 
with its surface oriented perpendicular to the X-axis 

± 45 deg (±0.785 rad) 

- The distance between the vehicle and satellite at contact 
shall be 1.5 £ x £ 6.1 m (5 £ x £ 20 ft). 

Finally, Fig. VII-19 defines the requirements for a spinning/ 

nutating satellite as: 

1) Working Volume 

- This shall be defined by a stable or nutating satellite 
4.6 m (15 ft) in diameter by -£ 18.4 m (£ 60 ft) long, with 
a nutation angle of ±45 deg (±0.785 rad) maximum. 
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Fig. VII-19 Satellite Retrieval 
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2) Working Site 

- Consists of the surface area of the satellite and its ap- 
pendages 

- Spin about roll axis: <10 rad/sec (£573 deg/sec) 

- Angular rate of nutation: <L rad/sec (£ 57,3 deg/sec) 

- Distance to site: £3.05 m (£10 ft) 

This application is considered to have three cases for satellite 
inspection/retrieval : 

1) Case 1 - Inspection: The FFTO is capable of maneuvering per- 

pendicular to the spheres defined above. 

2) Case 2 - Longitudinal Retrieval: The FFTO will attach on the 

longitudinal axis, as shown in Fig. VII-20. 

3) Case 3 - Center-Point Retrieval: Retrieval will take place 
within a volume ±3.05 m (10 ft) on all axes from the node shown 
in Fig. VII-21. 

The deployment/articulation requirements for these cases are based 
on the sensor location requirements, and fall into four categories: 

1) Sensor fixed to the FFTO; 

2) Base of sensor fixed; sensor provided with a variable line-of- 
sight (LOS); 

3) Sensor with variable base and variable LOS; 

4) Sensor attached to the FFTO manipulator. 

As shown in Fig. VII-22, only categories 2 and 3 require an articv 
ulation/ deployment subsystem . 
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Working Site 


Fig. VII-20 Longitudinal Retrieval 
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1) Fixed to FFTO 


2) Base Fixed - LOS Variable 



1 . 


3) Variable Base- 4) Manipulator Attached 

Variable LOS 

Fig . VII-22 FFTO Sensor Locations 



Fixed-Base Configuration 


If the visual sensors are rigidly attached to the FFTO, the sys- 
tem has an advantage in that the view will probably be aligned 
to the FFTO control axis. 


Thus, camera control is minimal and the field of view is sufficient 
for some tasks, such as docking and flyaround inspection. Satel- 
lite maintenance, however, presents the most stringent require- 
ments on the visual system, primarily due to the back-surface 
vision required. Using the fixed-sensor configuration, no back- 
surface vision is possible. 


For example consider a fixed sensor and assume that visual infor- 
mation is available anywhere within the volume of a cone described 
by the FOV angle and the perpendicular distance from the image. 

Thus, the volume covered by a 60-deg (1.047-rad) FOV fixed sensor 
at a distance of 3.05 m (10 ft) is approximately 10.6 cu m (375 cu ft). 
In contrast, the net working volume for satellite maintenance (no 
plane included) is 37.5 cu m (1344 cu ft). If an average value 
is used for the cone height within the working volume, then the 
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number of 60-deg (1.047-rad) FOV sensors required— independent of 
sensor position, and with no visual overlap — is forty five. Using 
the same assumptions for satellite retrieval, at least 11 sensors 
would be required. 

In satellite inspection/retrieval, only one sensor is required for 
Case 1, assuming that the entire area does not require simultaneous 
viewing. At a position 3.05 m (10 ft) from the inspection sphere, 
less than four vehicle attitude orientations or four individual 
sensors are required to view one-half of the surface. The variable 
in this viewing situation is the surface that is normal with re- 
spect to the sensor. 

For case 2, longitudinal retrieval, an FFTO-attached sensor will 
not provide adequate vision at the 45-deg (0.785-rad) maximum 
nutation angle and the maximum distance [3.05 m (10 ft)] from the 
work site. Instead, the minimum required distance for minimum 
viewing angles is 4 m (13 ft). And even at this distance, simul- 
taneous viewing requires twelve 60-deg (1.047-rad) FOV sensors. 

Covering the viewing area at the maximum distance for center-point 
retrieval, using the area assumptions previously discussed, re- 
quires a minimum of three sensors. 

2. Fixed-Base, Variable-LOS Configuration 

This category allows the sensors to pan/tilt about a fixed location 
on the vehicle. The most advantageous positions on the vehicle 
are at the diagonally opposed corners of the FFTO, provided that 
the FOV has a pan of ±180 deg (±3.142 rad) and a tilt angle of 
±90 deg (±1.571 rad), as defined in Fig. VII-23. 



Fig. VII-23 Fixed-Base } Variable- LOS Configuration 
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'For satellite maintenance, this configuration provides visual in- 
formation on the entire working volume, including vision on the 
working site at the minimum distance from the vehicle [assuming 
visual information is significant at 75 deg (1.309 rad) from the 
plane of the working site]. The configuration, however, can lead 
to occlusion of the work site and does not provide back-surface 
vision. Nevertheless, the two-sensor system does provide an ade- 
quate FOV for satellite retrieval and the satellite inspection/ 
retrieval tasks. Longitudinal retrieval will still require a 
minimum separation distance of 4 m (13 ft) at the maximum nutation 
angle. 

3. Variable-Base, Variable-LQS Configuration 

This category is the first to provide back-surface vision for 
satellite maintenance and is considered to use both fixed-length 
and extendable booms. The most favorable location for the boom 
is at the forward corner of the vehicle since this gives maximum 
separation from the manipulator and minimize interference. The 
base should be capable of accommodating boom pitch and yaw angles 
of +90 deg (1.571 rad) and ±90 deg (±1.571 rad), respectively, and 
should allow the sensor to pan through ±180 deg (±3.142 rad) and 
tilt from +180 deg (+3.142 rad) to -105 deg (-1.833 rad) (see 
Fig. VII-24). 

A long, fixed-length boom increases the operators vision of the 
back of the work site, but imposes a requirement to use an ad- 
ditional sensor in the center of the vehicle. This extra sensor 
is used (1) when the boom-mounted sensor’s view of the front of 
the work site is occluded by the vehicle and (2) when the use 
of the fixed-length boom results in a large angle between the 
sensor’s line of sight and a plane normal to the working surface 
(see Fig. VII-25) . 

Each 60-deg (1.047-rad) FOV sensor will have four positions for 
viewing the entire work surface at the minimum distance from the 
vehicle. The minimum boom length for worst-case maintenance (i . e . , 
• when back-surface vision is required and when the boom must ex- 
tend diagonally across the top of the work site) is approximately 
3.05 m (10 ft). If the work site is then rotated through the 
permissible ±20 deg (±0.349 rad), the opposite edge of the surface 
is moved toward the vehicle so that boom length does not have to 
be increased. 
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Minimum 

h — H 

■ Maximum Distance 


Fig 1 . VII- 2 5 Fixed-Length Boom Geometry 
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If an elbow is used on the boom to vary the base, interference 
between the work surface, the manipulator, and the dedicated boom 
may become a significant problem due to the volume used by the 
elbow and the two articulated lengths. 

From a visual sensor standpoint, the main difference between using 
the fixed-length boom and the extendable boom (furlable tube) 
involves the deployment method. But in the latter case, only one 
sensor is required since the extendable boom can be deployed be- 
tween the work site and the vehicle (Fig. VII-26) . The variable- 
base, variable-LOS category also offers advantages in providing 
a flexible (several-sided) view at the work site. 

For satellite retrieval, the distance required for a 60-deg (1.047- 
rad) FOV sensor to see the 4.6-m (15-ft) diameter of the satellite 
is 3.7 m (12.5 ft), with the sensor perpendicular to the end of 
the satellite; and the worst-case boom length is 10.4 m (34 ft). 

For satellite inspection/retrieval, the variable-base, variable- 
LOS configuration provides adequate viewing. However, longitudinal 
retrieval, assuming a worst-case nutation angle, requires a boom 
length of 10 m (33 ft). 



Fig . VII-26 Extendable-Boom , Variable- Base, 
Variable-LOS Concept 




4. 


Manipulator-Attached Conf iguration 

From a visual standpoint, it is necessary to assume that the manip- 
ulator can reach any location within the specified working volumes. 
Thus, the visual system need only interface with the functional 
requirements of the manipulator to minimize the occultation of the 
FOV by the manipulator. A recommended configuration is to mount a 
two-degree-of-f reedom sensor on the longitudinal axis of the last 
manipulator segment so that the sensor can rotate around the end 
of the segment and tilt perpendicular to its axis. 

The occultation can be further minimized in two ways: 

1) Deploy the sensor on an extendable boom 1 m (3.25 ft) long; 

2) Use a second sensor on the next (inboard) segment of the 
manipulator. 

The manipulator-attached sensor represents the. simplest configura- 
tion capable of performing within the total working volume. The 
sensor controls required to track the manipulator will be minimal 
and, depending on the task, the operator can control the sensor 
manually. However, this configuration has a disadvantage in that 
the view from the sensor presents a "moving window" to the operator, 
whereas the deployed, dedicated boom presents the manipulator 
moving within a "static window." Despite this, the problems as- 
sociated with this effect can be minimized by providing a FFTO 
position-holding capability. Thus, the operator would know the 
motion of the manipulator arm, viewed from the sensor, relative 
to the FFTO. 

Figure VII-27 is a simplified summary of the boom length required 
to meet visual requirements. The figure indicates that: 

1) Simplified inspection, front-side maintenance, and retrieval 
tasks can be accomplished with FFTO-attached sensors; 

2) Complex inspection, front-side maintenance, and retrieval 
tasks can be accomplished using two fixed-base, variable-LOS 
sensors; 

3) Back-surface maintenance requires a variable-base, variable- 
LOS sensor on a boom at least 3.05 m (10 ft) long; 

4) Inspection and retrieval of a nutating satellite requires a 
dedicated boom for the sensor or a manipulator— attached sensor. 
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Fig. VII-27 Visual Requirements Summary 

5. Deployment 

Although the exact method used to pan, tilt, and deploy the sen- 
sors remains task/conf iguration-dependent, several space-qualified 
mechanisms already exist. The pan-tilt gimbals for the Apollo 
lunar roving vehicle-TV control unit, the Viking high-gain antenna, 
and the pointing head for the Skylab T027 photometer are typical 
examples. Sensor deployment can also be accomplished using ex- 
tendable devices, such as furlable booms, or fixed-length jointed 
members that may have either one degree of freedom or two degrees 
of freedom, similar to the pan-tilt gimbals between the member. 

The technology used in placing the sensor can also take advantage 
of manipulators and their articulation devices. 

a. Pan-Tilt Devices - The Apollo TV control unit is a 5.7-kg 
(12.6-lb) device that serves as a pan-tilt mount for the color TV 
camera and permits manual or ground— controlled TV coverage from 
the Apollo lunar roving vehicle. The azimuth/elevation pedestal 
allows the TV to pan over 170 deg (2.967 rad) right and left of 
forward, and to tilt from 45 deg (0.785 rad) below to 85 deg (1.484 rad) 
above horizontal. The drives are geared stepping-motors that pro- 
vide a pan rate of 3.03 deg/sec (0.053 rad/sec) and a tilt rate of 
3.12 deg/sec (0.055 rad/sec). 
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The TV control unit receives a 70-kHz modulated subcarrier signal 
from the lunar communications relay unit, decodes this signal, 
and executes valid real-time commands. 

The Viking high-gain antenna is mechanically pointed about two 
axes by the onboard guidance and control sequencing computer. 

The assembly can orient the beam through an elevation of +90 
deg to -22 deg <+1.571 rad to -0.384 rad) and an azimuth of ±338 
deg (±5.899 rad) with an error of £0.7 deg (£0.012 rad) throughout 
the entire pan-tilt range. The antenna moves in 0.30-deg (0.005- 
rad) steps at angular rates up to 0.60 deg/sec (0.010 rad/sec). 

The pointing mechanism uses 3.5 w. 

Unless power is applied the antenna will remain fixed within the 
pointing error. Since the antenna is designed to maintain its 
pointing accuracy under the loads imposed by the Martian environ- 
ment (including surface winds and temperature gradients) , a similar 
mechanism should be able to withstand the dynamic loads imposed 
by the visual system tasks. 

The Skylab T027 mast has a gimbal mechanism that can either be 
pointed manually or by automatic programming. The azimuth and 
elevation are controlled by two 400-Hz, square-wave, synchronous 
electric motors that operate at rates up to 4 deg/sec (0.070 rad/ 
sec). The elevation sweeps from 0 to 112.5 deg (0 to 1.964 rad), 
and the azimuth, from 0 to. 354 deg (0 to 2.033 rad). 

b. Extendable Devices - The Experiment T027 photometer is deployed 
using an extendable/retractable scissors-like mechanism containing 
some 368 links and 44 spider assemblies. The mast is designed 
to be operated manually, but drive mechanisms could be developed. 

Furlable booms operate on the principle that the thin metal ele- 
ment has a lower potential energy when deployed. The metal ele- 
ment is stored on a spool in such a manner as to remain within 
the material f s elastic limit. No permanent strain is introduced 
to the material, thus guaranteeing that it always returns to its 
tubular form, even after repeated extensions and retractions. 

When subjected to a compressive end load, the typical element 
eventually fails due to local buckling. Long furlable elements 
behave like typical columns, so the Euler equations for column 
buckling can be used. When subjected to repeated bending, the 
elements eventually fail due to local buckling at the edges of 
the element caused by high local stresses. The torque at which 
an element fails by local buckling is relatively small unless the 
edges of the elements are interlocked. 
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Several tubular configurations have been developed to enhance the 
physical properties of the furlable elements. These mechanisms 
have been space-qualified and used for a number of space activities, 
including satellite stabilization and instrument deployment. 

The Viking surface sampler consists of an electromechanically 
operated collector head that can be deployed to multiple sampling 
sites up to 3.04 m (10 ft) from the lander within a 120-deg (2.094- 
rad) arc. The deployment of the collector head is accomplished 
by a gimbaled, furlable-tube boom. The sampler head is capable of 
360-deg (6.283-rad) rotation for sample-sieving activities. 

The gimbaled base has an elevation rotation rate of 45 deg/minute 
(0.785 rad/minute) and elevation limits of 45 deg (0.785 rad) up 
to 50 deg (0.873 rad) down from the horizontal. The azimuth ro- 
tation rate is 180 deg/minute (3.142 rad/minute), with +90-deg to 
-205-deg (+1. 693-rad to -3.578-rad) travel limits. 

The boom has a mass of approximately 7.3 kg (16 lb) and extends/ 
retracts at a rate of 0.76 meter/minute (2.5 feet/minute). At 
3.3 m (133 in.) the extension force is 133 N (30 lb); the retrac- 
tion force is 89 N (20 lb); and the elevation force is 17.75 N 
(4.5 lb). 

The boom is digitally controlled and programmed to sample at eight 
different locations at 24-deg (0.419-rad) increments. The net 
resolution is 0.5 deg (0.008 rad) in elevation, 0.18 deg (0.003 
rad) in azimuth, and 0.5 cm (0.23 in.) for extension/retraction. 

The boom requires 50 w of peak power and 25 w of nominal power. 
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F. 


TELECOMMUNICATIONS 


1. General Discussion 

The basic function of the telecommunication subsystem (TCS) is to 
provide the video, data, and control links between the remote con- 
trol station and the visual system aboard the FFTO. Since both 
the preliminary visual system candidates (monocular and stereo) 
use TV cameras as the sensors, the range of telecommunication 
concepts becomes restrictive. 

The camera control signals and data (other than video) — even for 
several cameras — require a very low information rate, probably 
less than that for certain other subsystems aboard the FFTO. There- 
fore, all low-data-rate signals can be multiplexed together and 
transmitted or received via the RF link used for FFTO control and 
monitoring. 

The variety of visual system concepts will have little effect on 
the sizing of that system and will not be given further consider- 
ation in this phase, except to specify the signals that are needed. 
However, it should be noted that, video transmission requires a 
bandwidth far in excess of that needed by any other FFTO subsys- 
tem. 

The number and type of TV cameras greatly influence the size, 
weight, and power consumption of the TCS. Because the number of 
cameras required will be determined during man-in-the-loop simu- 
lations, this discussion will consider the basic capability needed 
to accommodate simultaneous operation of two or three cameras and 
will be modified if required, based on simulation results. As 
previously described in Section A of this chapter, the available 
TV cameras will conform to the 525-line, 30-f rame-per-second for- 
mat and have a bandwidth of 5 MHz per camera. 

2. Choice of Frequency 

The choice of the video transmission frequency will probably be 
influenced by commonality with the control and data links. How- 
ever, the visual system may well be the determining factor in 
such a selection for the entire FFTO communications. The following 
discussion will concentrate on the advantages and disadvantages of 
two practical frequency bands: S-band and VHF. 
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Frequency selection is complicated by a number of factors. As 
the wavelength is reduced, a conductive body of given dimensions 
becomes^a better reflector; and when an electromagnetic wave is 
reflected it undergoes a 180-deg (3.142-rad) reversal in phase. 

If the incident wave and reflected wave travel nearly the same 
path length, thus arriving at the receiving port at the same time, 
they will tend to cancel and there will be f, dead spots 1 * in the 
desired working volume. 

At S-band (2100 MHz) the wavelength is 15 cm and many surfaces 
on the Shuttle and/or the satellite are capable of reflecting the 
waves. At 300 MHz, the upper end of the'VHF spectrum, the wave- 
length is seven times that at S-band and the reflection problem 
is obviously less. From the standpoint of multipath reflections, 
VHF is a better choice. However, other factors are involved. 

Polarization of the wave by the transmitting antenna can greatly 
reduce the problem of reflection at S-band. For example, assume 
the wave is given a right-hand circular polarization. When the 
transmitted energy is reflected, its polarization also reverses — 
in this case to left-hand circular. Now, when the reflected sig- 
nal reaches the receiving antenna it has the opposite polarization. 
Thus, a wave must be reflected twice before it is accepted by the 
receiving antenna. The likelihood of a double reflection is less, 
and nonspecular reflection will further reduce the intensity, 
making M dead spots" about as rare as with VHF. 

Another consideration is that an antenna for 2100 MHz is one- 
seventh the size of an antenna for 300 MHz. S-band antennas can 
therefore be made either smaller and lighter, or can be endowed 
with better directional characteristics for a given volume. 

In addition, more S-band frequencies are authorized for satellite 
communications than at VHF, and more space-qualified S-band trans- 
mitting equipment has been developed. 

The primary drawback to using S-band is that efficiency of the 
transmitter chain is presently much lower than that for VHF in 
lightweight, solid-state equipment: normally, twice the input 

power is required at S-band for the same output power. In spite 
of this poorer efficiency S-band is a better overall choice than 
VHF for the visual system TCS unless there is a severe power pro- 
blem. 
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3. 


Antenna Configuration 

The high transmitted bandwidth of the video-modulated RF carrier 
will result in a higher effective radiated power (ERP) than that 
for low-bandwidth data signals. The ERP is a function of the 
actual RF output power and the gains of the transmitting and re- 
ceiving antennas. Three antenna configurations will now be eval- 
uated to determine the RF power required for one transmitter con- 
taining a single 5-MHz video channel. These configurations are 
as follows: 


1) Omnidirectional arrays on both the FFTO and the Shuttle; 

2) An omnidirectional array on the FFTO and 90-deg (1.571-rad) 
sector coverage antennas on the Shuttle; 

3) A steerable antenna on the FFTO and a 90-deg (1. 571-rad) sector 
coverage antenna on the Shuttle. 


The basic equation for the RF power required. 


= (S/N) BKT (4ttRA) 2 F 
T G T G R MP 

where 

P^, = required transmitter power 

(dependent variable) 

S/N = carrier signal-to-noise 
ratio = 13 db, 

B = bandwidth = 5 MHz, 

K = Boltzmann's constant = 

1.38 x 10- 23 > 

T = receiver noise temperature 
= 290°K, 

R = range of Shuttle to FFTO 
(independent variable) , 

Substituting known quantities, the 

required transmitter power for a g 


A = carrier wavelength = 15 cm 
(5.91 in.) 

F = receiver noise = 5 db, 

G t = transmitter antenna gain 

(depends on Configuration), 

G R = receiver antenna gain 

(depends on Configuration), 

M = margin = -0 db, 

P = polarization mismatch loss 
-3 db. 

final equation for evaluating 
ven configuration and range is 


10 log P T 78.8 + 10 (2 log R - log G T - log G R 
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This equation is plotted for the three antenna configurations in 
Fig. VII-28. It can be clearly seen that the steerable array con- 
figuration requires far less transmitted power at the specified 
maximum range of 3048 m (10,000 ft) than the other two concepts — 

17 mw as opposed to 1.3 and 5 w. 

The important result is that each of the configurations requires 
a transmitted power that is easily realizable at this range. How- 
ever, if this range is extended by a factor of 10, then the power 
required for configurations 2 and 3 goes to 130 and 500 w, respec- 
tively, which is no longer practical. In such a case the steerable 
array, which would require only 400 mw, would be the logical choice. 

The primary drawback to a steerable antenna system is its complex- 
ity. It must contain electronic circuits to determine the pointing 
error and a servomotor system to reposition the antenna as required. 
In addition, it must be capable of searching for the Shuttle if 
some maneuver puts the FFTO in an obscured location or at a posi- 
tioning limit. The steerable array that was baselined in the 
above calculation is the one designed for the Viking lander. This 
array weighs 7.26 kg (16 lb) and has a 76-cm (30 in.) parabolic 
reflector. 

The maneuverability of the FFTO must be matched by even greater 
pointing response of the antenna. Therefore, unless the power 
requirement is too great for a fixed antenna array, the added com- 
plexity and lowered reliability of a steerable antenna are not 
justified. 

For the FFTO/Shuttle video link, which is restricted to a maximum 
range of 3048 m (10,000 ft), using an omnidirectional antenna on 
the FFTO and a 90-deg (1.571-rad) sector coverage antenna on the 
Shuttle offers a good compromise between complexity and system 
power. A 2-w transmitter in the 2100-MHz frequency band requires 
no development, will meet all requirements, and will draw about 
25 w of spacecraft primary power. 

4. Effect of Long-Range Operation 

In the event that ground control of the FFTO and direct reception 
of FFTO video are needed, some perturbations in the nominal FFTO/ 
Shuttle telecommumications link will be required. 
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The range of the communications link can be increased by manipu- 
lating three variables: bandwidth, radiated power, and antenna 

gain. A reduction in bandwidth can be accomplished in a number 
of ways. The simplest of these is to reduce the horizontal scan 
rate either by relaxing the resolution requirements or reducing 
the frame rate. The present state of the art provides little 
margin for reducing the resolution; in fact, an increase is de- 
sirable.. Reducing the frame rate will require scan conversion, 
which is practical on the ground but not yet developed for space 
use. Thus, using the same system for both short and long distances 
necessitates using a dual scan-rate system, which would be in a 
developmental category. Other methods of bandwidth reduction, 
such as data compression, are warranted only for long-duration 
interplanetary flights; for earth-orbital applications, there are 
more desirable ways of achieving highly reliable communications. 


By 1975 it may be possible to use a solid-state S-band transmitter 
having an output power of 10 w. With this output power and the 
FFTO omnidirectional communications system previously discussed, 
the maximum range (R) from the ground-based station will be 


X PlW 1** 
4tt |_(S/N) BKTF_ 


8000 km (4300 n mi) 


where 


13 db, 

5 MHz, 

(ground looking toward 
space) = 55°K, 

1.38 x 10- 23 


P = -3 db, 

The system described above is therefore useful for low and medium 
earth orbit. Although communication would be possible out to 
synchronous orbit, the margin would be exceeded and the signal- 
to-noise ratio would be severely degraded. Moreover, a simultaneous 
transmission of more than one picture would be impractical due to 


X = 15 cm (5.91 in.), S/N = 

P T = 10 w, B = 

g t = 0 db, T 

G p [for a 24.4-m (80-ft) dish] K = 

= 51.9 db, 

F 
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the greater weight and power requirements 'of the 10-w transmitter; 
that is, it would no longer be feasible to have two or three trans- 
mitters aboard the FFTO, as it would be. for short ranges. 


To maintain the system's required capability at distances out to 
synchronous orbit, it will be necessary to employ a directional 
antenna array on the FFTO. A suitable space-qualified antenna 
is the 7 6- cm (30-in.) dish to be used in the Viking program, which 
has a gain at S-band of 22 db. The following calculation shows 
the transmitter power necessary to provide video communication 
from synchronous orbit to the ground. 


S/N = 13 db 

B =5 MHz 

T = 55°K 

X = 15 cm (5.91 in.) 

F =5 db 

M = -9 db 

(S/N) BKT (4ttR/X) 2 F 
P T G T G R MP 



1. 4 w 


-3 db 
22 db 

51.9 db 

3.6 x 10 9 cm (19,300 n mi) 
1.38 x 10~ 23 


This power requirement is very much in line with the transmitters 
planned for the short-range FFTO/Shuttle missions. The primary 
disadvantages are, of course, the additional complexity in the 
electronics needed to control antenna pointing and the extra weight 
and power needed for the antenna and associated drive mechanisms. 
These tracking systems are, however, off-the-shelf items and would 
be easily adaptable for FFTO use. 


A secondary disadvantage is that operation would either have to 
be restricted to the earth side of the target vehicle or an ex- 
tendable antenna boom would have to be used to prevent occultation 
of the signals by the target vehicle. For the recommended system 
using the Viking lander S-band steering array, and with no ex- 
tendable boom, the deltas are as follows: weight, +6.80 kg (+15 

lb); average power, +20 w; envelope to include a 76-cm (30-in.) 
dish. 
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5. 


T e 1 e c ommunication Video Link 


The number of transmitters and their modulation bandwidth will 
depend on the maximum number of FFTO TV cameras required to func- 
tion simultaneously. Each of the candidate concepts may require 
up to three cameras in operation at any given time. It is assumed 
each TV camera has an information bandwidth of 5 MHz and needs 
an equivalent RF bandwidth of at least that magnitude. 

a. Synchronous Video Switching - Figure VII- 29 shows a method by 
which signals from three cameras (or two in other configurations) 
may be time-multiplexed so that only a single 5-MHz bandwidth 
transmission channel is required. A synchronous, solid-state video 
switch is used to sample the video from each camera a field or 
frame at a time; i.e., the signal input to the transmitter may 
consist of one frame from camera 1, followed by one frame from 
camera 2, followed by one frame from camera 3, followed by a sec- 
ond frame from camera 1, etc. At the receiving end, the demodu- 
lated signal is separated in the opposite manner. Thus, after 
monitor 1 receives a frame from camera 1, there are two frame 
periods during which no signal appears at this monitor. In the 
meantime monitors two and three are receiving their respective 
frames. 

The drawback to this system is obvious: if the normal frame rate 

is 30 frames per sec, each monitor will display one-third that 
number, or 10 frames per sec. Since the nominal flicker-fusion 
frequency of the human eye is between 20 and 24 frames per sec, 
a two-camera system with a flicker rate of 15 frames per sec would 
be marginal, and 10 frames per sec for the three-camera configu- 
ration would be very objectionable. 

The flicker can be eliminated by using an image storage device, 
such as a storage tube or magnetic disc, that holds the previous 
picture until it is updated, but these devices are presently only 
in the developmental stages and no space-qualified versions yet 
exist. One of these devices would be needed for each monitor 
that is to be viewed simultaneously. In addition, motion rendition 
would suffer because the picture update rate would be inversely 
proportional to the number of cameras in the system. 
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Fig. VII- 29 Synchronous Video 
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To simultaneously transmit, multiple-camera video signals without 
a loss of information, the overall bandwidth must increase to in- 
clude each wideband signal; i.e., increase to 10 MHz for two 
cameras or to 15 MHz for three. There are two common methods for 
handling these requirements: (1) the video signals may be fre- 

quency-modulated on separate subcarriers which, in turn, are fre- 
quency-modulated onto a common carrier and transmitted by a single, 
extra-wideband transmitter, or (2) each video signal may modulate 
a separate transmitter. 

b. Extra-Wideband Single Video Link - Figure VII-30 depicts the 
first method. Its primary advantages over using separate trans- 
mitters for each channel are savings in power and weight. For 
equivalent receivers, the single 15-MHz channel must transmit 
three times the RF power of a 5-MHz channel for the same received 
signal-to-noise ratio. However, if three separate receivers are 
used in parallel for the 5-MHz signals, a power divider must then 
be used to route the signals to each receiver input. 

A factor-of-three loss for the divider means that three times the 
received RF power is needed. Therefore, the total power needed 
for a single 15-MHz RF link is one-third the power required for 
three 5-MHz parallel links. 

The circuitry is also more complex since subcarrier oscillators 
must be provided for frequency-division multiplexing (FDM) . At 
the receiving end, the 15-MHz bandwidth places excessive demands 
on a single IF amplifier. To compensate for this, the receiver 
uses a separate IF amplifier for each video channel. The re- 
ceiver must thus be a specially designed piece of equipment that 
is nearly as complex as using three separate receivers. 

In addition, the reliability requirements are very high since 
there is no provision for redundancy. A single-point failure in 
any of the common circuitry could terminate the mission and even 
cause loss of the FFTO. 

q . Separate- Channel Video Link - The most straightforward means of 
transmitting the video information is shown in Fig. VII-31, which 
again depicts the three-camera simultaneous-viewing configuration. 
In this setup each camera is associated with its own transmitter. 
The transmitter outputs are summed and routed to a common antenna 
for transission to the Shuttle. There the signals are separated 
by a power divider and sent to the individual receiver inputs, 
where they are amplified, converted, and detected in standard man- 
mer. The video outputs then go to each monitor. 
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This method has two outstanding advantages. The first advantage 
is simplicity. All the techniques and equipment are well developed 
and exist in ‘"off-the-shelf" space-qualified hardware. The sec- 
ond advantage is redundancy. The three transmitters can provide 
some continuing telecommunications in the event of almost any 
single-point failure. Additional versatility in a contingency 
situation may be gained by including a remotely controlled switch- 
ing circuit so that any camera may be associated with any trans- 
mitter. 

Three camera/RF link configurations have been described for visual 
system telecommunications. The first, employing field or frame- 
rate video switching, is unsatisfactory for display complications. 
The second, which uses a single extra-wideband channel, is advan- 
tageous from a weight and power standpoint but is complicated and 
lacks redundancy. The third configuration has a separate link 
for each channel, but uses common antennas. This offers a straight- 
forward, redundant system, but has a weight and power penalty. 

Since the required power and the corresponding weight are quite 
low to begin with and do not seriously affect the overall FFTO 
power and weight limitations, this third alternative is our re- 
commended system. 

6 . Effect of Using Manipulator-Mounted Cameras 

In considering video transmission from an arm-mounted camera on 
the FFTO to the Shuttle, one possible method is to use an RF link 
to eliminate the signal cabling between the camera and the tele- 
communications electronics in the body of the FFTO. Such an RF 
link can be configured in two ways, as shown in Fig. VII-32. 

a. End Effeetor-to-FFTO RF Link - In the first approach, a low- 
power (10-mw) transmitter is used to transmit the video to the 
FFTO telecommunications. The received video is demodulated and then 
handled in the same manner as the video from other onboard cameras. 

Martin Marietta expended considerable effort on a very similar 
problem in the Shuttle-attached manipulator system during Contract 
NAS9-11932, Preliminary Design of a Shuttle Docking and Cargo 
Handling System . This study investigated the RF transmission of 
not only camera video, but also the command and data signals for 
the arm joints and the end effector with the intent of reducing 
the multiplicity of cabling around the arm joints and minimizing 
the attendant flexure problems. 
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In the present case, the conclusion favoring hardwired signals 
is even more. valid since the consideration only includes the wide- 
band video RF transmission link. Other requirements are as fol- 
lows. First, the RF link will require a transmitter and antenna 
mounted at the end of the arm, or at least on the end-effector ^ 
side of the elbow joint. Second, in order to avoid extreme com- 
plexity, the antenna must have a wide beamwidth to eliminate point- 
ing requirements; but the wider the beamwidth, the more susceptible 
is the system to multipath reflections. Next, the manipulator 
must be able to withstand greater loads due to the higher inertia 
near the tip of the arm. Fourth, a receiving antenna must be pro- 
vided on the body of the FFTO, and this antenna must have a beam- 
width sufficient to cover the entire working area of the manipula- 
tor arm. Finally, a receiver will have to be provided to recover 
the video to be handled by the telecommunications system for re- 
transmission to the Shuttle. 

It is clear from the preceding discussion that there is no advan- 
tage in using an RF system to transfer information around the arm 
joints. Some type of cabling must be provided in any event to 
provide power (since battery weight at the end of the arm is pro- 
hibitive) , and adding a single cable to handle camera video is 
a far better alternative than adding the complexity of an RF trans- 
mission system. 

b. End Effector-to-Shuttle RF Link - The second configuration 
in Fig. VII-32 shows an RF link directly from the end-effector 
TV camera to the Shuttle. This approach is valid from the stand- 
point that it is not necessary to add additional equipment ex- 
cept for a transmitting antenna. In addition, the multiplexing 
in the main FFTO antenna equipment is slightly simplified by 
eliminating one channel. 

The weight of the additional antenna at the end of the manipulator 
arm and the problem that the antenna might obscure the view of 
the end effector by the other cameras are negative factors. The 
most serious disadvantage is that an antenna located on the manip- 
ulator is very easily obscured by the target vehicle on one side 
and the FFTO itself on the opposite side. There is no practical 
method of eliminating such occultations . 
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The above discussion clearly shows that the preferred mode for 
processing the video from a camera at the end of a manipulator 
arm is to provide a hardline connection between the camera and 
the primary telecommunication electronics. Thus, the video can 
be handled in the same manner as the video from other onboard TV 
cameras, and the system is simple, yet versatile. 

7. Four-Camera Visual System Telecommunications Concept 

Figure VII-33 is a block diagram for a visual system concept that 
uses four TV cameras — one stereo pair and two separate cameras for 
alternate viewing. This configuration embodies the "any-camera, 
any-transmitter" philosophy. 

After a command signal is transmitted from the control station to 
the FFTO, the signal is routed by the diplexer to the command re- 
ceiver, where it is amplified and the command subcarrier is de- 
modulated. The commands are separated in the command decoder and 
sent to the appropriate visual system components, as well as to 
the other subsystems. 

Each of the four cameras can be turned on and off by commands 
from the control station. Other commands control the lens zoom, 
focus, and iris, the automatic light control (ALC) , and camera- 
mount positioning, including variable baseline positioning for 
the stereo pair. 

Video from each camera is routed to the video switching network. 

In response to commands from the Shuttle control station, video 
from three of the four cameras can be combined with a data sub- 
carrier if desired and used to modulate the video transmitters. 

Status data from the transmitters (an on-off indication for RF 
output power) and an indication of camera functions are input to 
the data encoder for relay to the operator. Required data from 
other subsystems are also sent to the data encoder. The encoded 
PCM data can either be used to modulate a low-power data trans- 
mitter in the normal mode or be placed on a subcarrier and added 
to the camera video in the contingency mode. The transmitter out- 
puts are added in the power summer and routed to the antenna 
through the diplexer. 
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Fig. VII- ZZ Four-Camera Visual System Teleccrmrunications Block Diagram 
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The block diagram shown here represents the most complex config- 
uration to be investigated. The variations occur in the number of 
TV cameras and video transmitters employed. These components are 
essentially in parallel and can be removed to alter the config- 
uration without changing the overall signal flow. Of course, with 
fewer cameras or fewer video transmitters, the video switching 
network becomes less complex. 

8. Summary 

Table VII-7 summarizes the characteristics of the telecommunica- 
tions subsystem and shows the differences between the monocular 
and stereoscopic concepts. 


Table VII-7 Monocular and Stereoscopic Concept Summary 


Parameter 

Monoscopic 

Stereoscopic 

Bandwidth 

5 MHz 

10 MHz 

No. of 

Video Transmitters 

1 

2 

RF Output Power 

1.5 w 

3* 0 w 

dc Input Power 

15 w 

30 w 

Frequency 

2100 MHz 

2100 MHz 

Antenna 

Omnidirectional ; 

Circularly 

Polarized 

Omnidirectional ; 

Circularly 

Polarized 


G. SUMMARY OF SUBSYSTEM REQUIREMENTS 


In the preceding sections it was shown that two basic systems 
emerge as possible candidates. The two candidates are monoscopic 
TV and stereoscopic-f resnel TV. These two systems and their sub- 
system characteristics are shown in Table VII-8. 

Table VII-8 pertains only to a monoscopic TV system with one camera 
and one monitor, and to a stereoscopic TV with one sensor package 
(two cameras) and one stereoscopic display. The total visual sys- 
tem may include one or more monoscopic TV systems or a combination 
of stereoscopic and monoscopic systems. 
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The determination of the total visual system concept is subject 
to detailed simulations, and the results of these simulations 
will be used to recommend candidate visual systems that contain 
some combination of the two video systems (monoscopic and/or 
stereoscopic-f resnel) . 


Table VII- 8 Typical Video System Characteristics 


Subsystem Parameter 

Monoscopic 

Stereos copic-Fresnel 

Sensor 



Bandwidth 

5 MHz 

10 MHz 

Power 

12 w 

24 w 

Weight 

2.8 kg (6.2 lb) 

5.6 kg (12.4 lb) 

Size 

2600 cm 3 (158.6 in. 3 ) 

5200 cm 3 (317.2 in. 3 ) 

Illumination 



Maximum Working 

6.1 m (20 ft) 

6.1 m (20 ft) 

Distance 



Brightness 

40 ft-lamberts (137 
Cd/m 2 ) 

40 ft-lamberts (137 
Cd/m 2 ) 

Power 

62 w 

62 w 

Display 

30 cm (12 in.) 


Monitor Size 

7.6 cm (3 in. ) 

Power 

60 w 

1. 6 w 

Weight 

11.3 kg (25 lb) 

9.1 kg (20 lb) 
(estimated) 

Size 

27 x 10 3 cm 3 
(1648 in. 3 ) 

28 x 10 3 cm 3 (estimated) 
(1709 in. 3 ) 

Telecommunications 



Bandwidth 

5 MHz 

10 MHz 

Transmitted 

2 w 

4 w 

Power 



Carrier 

2100 MHz 

2100 MHz 

Frequency 



Antenna 

Omnidirectional , 
90-deg (1.571-rad) 
Sector 

Omnidirectional, 90-deg 
(1.571-rad) Sector 

Articulation 

Concept- 

Dependent 

Concept- 

Dependent 
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VIII. CONCEPT EVALUATION 


A. SIMULATION SUMMARY 


Following the systems requirements definition and the development 
of several stereo system techniques, we derived a simulation plan 
for systems evaluation simulations and constructed a stereo TV 
system, along withvarious mockups, controls, and displays. Four 
separate simulations were conducted and the results of these sim- 
ulations were analyzed. The work presented in this section was 
performed under Independent Research and Development (IRAD) Task 
No. 48664. 

The simulation plan is summarized in Table VIII-1 and the sim- 
ulation results are summarized in Table VIII-2. The next section 
describes the visual system used in the simulations. The remainder 
of the chapter gives a brief summary of each simulation experiment 
with discussions of results and conclusions. 


B. VISUAL SYSTEM APPARATUS 


The visual system apparatus was similar for both the monoscopic 
and stereoscopic task simulations. In each case a Norelco LDH- 
0050 camera (or pair of cameras) with a 20-mm lens was used for 
the sensor. The stereoscopic sensor cameras were held at a con- 
vergence angle of 11 deg (0.192 rad) and a baseline reference of 
12.7 cm (5 in.) for all simulations. Two Audiotronics MMA-10 
monitors were used in the monoscopic TV display. These were 
capable of a measured resolution of 350 lines on the 25.4-cm 
(10-in.) monitor face, and were viewed directly. The stereoscopic 
display consisted of two Audiotronics MGM-931 mini-monitors, ca- 
pable of a resolution of only 300 lines, projected onto a 25.4-cm 
(10-in.) fresnel display lens. The difference in resolution be- 
tween the monoscopic and stereoscopic displays was approximatley 
17/£. A design drawing of the stereoscopic display is shown in 
Fig. VIII-1. 
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Table VIII-1 Teleoperator Visual System Simulation Plan 



VIII-2 







Table VII I- 2 Teleoperator Visual System Simulation Results 
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t LOS - Line-of-sight . 









The FQV of the mcnoscopic system with a 20-mm lens, is 27 deg 
(0.471 rad) in the horizontal plane and 20 deg (0.349 rad) in the 
vertical plane. The FOV of the stereo system is part stereo and 
part mono. The stereo horizontal FOV goes from 27 deg (0.471 rad) 
(the FOV of the camera-lens) in close, to 16 deg (0.279 rad) (the 
FOV of the camera-lens minus the convergence angle) at infinity. 
The total (stereo and monoscopic) horizontal FOV is equal to 27 
deg (0.471 rad) (the FOV of the camera-lens) in close, and is 
equal to 38 deg (0.663 rad) (the FOV of the camera-lens plus the 
convergence angle) at infinity. The stereo vertical FOV is con- 
stant for all ranges and is equal to 20 deg (0.349 rad). 


SIMULATION OF VISUAL SYSTEMS FOR BASIC DEPTH ALIGNMENT 


Basic information was required on visual systems for various re- 
mote viewing tasks. The variables of interest were monocular vs 
stereo viewing, the position of the camera, and the shapes and 
sizes of objects. The remote viewing task was to align two ob- 
jects in a plane. 

Apparatus 

The experimental hardware consisted of a stand with only one hori- 
zontal degree of freedom, a stationary stand, two cameras with 
10-mm lenses, a stereo fresnel display monitor, a monocular TV 
monitor, and three types of blocks: 

1) Two rectangular blocks 12.7 cm (5 in.) high by 5.08 cm, (2 in.) 
wide by 5.08 cm (2 in.) deep. 

2) Two cylindrical blocks 12.7 cm (5 in.) high by 5.08 cm (2 in.) 
in diameter. 

3) One rectangular block 10.16 cm (4 in.) high by 3.81 cm (1.5 
in.) wide by 3.81 cm (1.5 in.) deep. 

These blocks were painted a flat white and were used against a 
black background. 

Method 


The task of the experiment was to align two objects in the same 
horizontal (X-Y) plane. One object was fixed in place and the 
other could be moved along a horizontal line (X). The objects 
were maintained 5.08 cm (2 in.) apart in Y. The movable object 
was either started from 10.2 to 25.4 cm (4 to 10 in.) in front 
of or behind the fixed object. The exact starting distance was 
random. Once the movable object was started towards the fixed 
object, it was stopped on command when the subject perceived that 
the two objects were aligned in a vertical plane normal to the 
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line of motion (LOM) . The alignment error was recorded by the 
experimenter. The subject was then asked to command corrections 
until he felt that the position was as good as he could get it. 
Time and error were recorded for this second phase. 

The independent variables were: (1) shape of object (either cy- 

lindrical or rectangular); (2) size of objects (either equal or 
unequal); (3) direction of motion of movable object either toward 
or away from the camera) ; (4) dimension of view (either mono or 
stereo); and (5) camera location (optical axis boresighted along 
the LOM; optical axis 30 deg (0.524 rad) above the LOM; or optical 
axis 30 deg (0.524 rad) to the left of the LOM. The dependent 
variables were the initial alignment accuracy, the final align-, 
ment accuracy, and the time differential between the two. 

The experimental order of the independent variables were counter- 
balanced across six different subjects. Each subject was given 
an eye examination. The results of this examination are given 
in Table VIII-3. 

Table VIII-3 Subjects ' Eye Examination Results 


Visual Parameter 

Subject 
1 FG 

Subject 
2 MS 

Subject 
3 DR 

Subject 
4 RB 

Subject 
5 DJ 

Subject 
6 JC 

Near Acuity 
Uncorrected 







R 

20/29 

20/50 

20/18 

20/17 

20/22 

20/18 

L 

20/29 

20/50 

20/17 

20/20 

20/20 

20/25 

Both 

NA 

NA 

20/17 

20/17 

20/20 

20/17 

Near Acuity 




* 



Corrected 







R 

20/20 

20/22 

NA 

NA 

NA 

NA 

L 

20/22 

20/18 

NA 

NA 

. NA 

NA 

Both 

20/20 

20/17 

NA 

NA 

NA 

NA 

Far Acuity 
Uncorrected 







R 

20/33 

20/ 2Q0 

20/18 

20/22 

20/18 

20/20 

L 

20/40 

20/200 

20/18 

20/25 

20/25 

20/17 

Both 

NA 

NA 

20/17 

20/20 

20/18 

20/17 

Far Acuity 
Corrected 

R 

20/22 

20/22 

NA 

* 

NA 

NA 

NA 

L 

20/22 

20/20 

NA 

NA 

NA 

NA 

Both 

20/20 

20/18 

NA 

NA 

NA 

NA 

Color Vision 

OK 

OK 

OK 

OK 

OK 

OK 

Depth Perception 

78% 

1007. 

100% 

65% 

100% 

33% 

Near Phorla 




mm 



Vertical 

5 OK 

4 OK 

OK 


5 OK 

4 OK 

Lateral 

8 OK 

4 t 

OK 

«i 

6 OK 

8 OK 

Far Phoria 







Vertical 

4 OK 

5 OK 

OK 

5 OK 

5 OK 

5 OK 

Lateral 

8 OK 

8 OK 

OK 

7 OK 

9 OK 

8 OK 

t Not quite normal. 

* Normally wears glasses. 
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3. 


Results 


Table VIII-4 summarizes the errors recorded during the simulation. 


Table VIII-4 Mean Errors in Basic Depth Alignment Simulation 


Objects 

Visual 

System 

Camera Location 

LOM 

30 deg 
(0.5 rad) Up 

30 deg 

(0.5 rad) Left 

Equal Size 
Cylinders 

Monoscopic 


1.59 cm 
(0.625 in.) 

3.13 cm 
(1.25 in.) 

Stereoscopic 

0.867 cm 
(0.341 in.) 

0.917 cm 
(0.361 in.) 

1.83 cm 
(0.721 in.) 

Equal Size 
Rectangles 

Mbnscopic 

1.82 cm 
(0.716 in.) 

0.85 cm 
(0.333 in.) 

3.40 cm 
(1.34 in.) 

Stereoscopic 

0.97 cm 
(0.382 in.) 

0.85 cm 
(0.333 in.) 

1.61 cm 
(0.632 in.) 

Unequal 

Size 

Rectangles 

Monscopic 

6.40 cm 
(2.52 in.) 

Not 

Evaluated 

Not 

Evaluated 

Stereoscopic 

1.40 cm 
(0.55 in.) 

Not 

Evaluated 

Not 

Evaluated 


These results are plotted in Fig. VIII-2 thru VIII-4. The corre- 
lation between the stereo acuity found in the eye examination 
and the stereo performance obtained in the simulation was 0.55, 
but this is not significant at a 90% confidence level. 
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a. Mono vs Stereo - Stereo viewing proved to be consistently 
better throughout these tests. This was expected because the task 
was a depth alignment test. 

On an overall basis, the mean error for stereo viewing was 1.19 cm 
(0.469 in.) and that for monoscopic viewing was 1.67 cm (0.658 in.). 
However, a "t" test comparing these means is not significant at 
a 90% confidence level. 

b . Viewing Angles - With stereo viewing for equal-size objects, 
there was very little difference between alignment accuracy for 
line-of-motion and 30-deg (0.524-rad) up; however, 30-deg (0.524- 
rad) left viewing was somewhat poorer. There was greater dif- 
ference in using different viewing angles with mono than stereo. 
Monocular viewing proved to be best at an angle of 30 deg (0.524 
rad) up and worst at 30 deg (0.524 rad) left. This was as ex- 
pected because the only cues in monocular viewing are size at 
the LOM camera position, both size and vertical position at 30 
deg (0.524 rad) up, and only horizontal position at 30 deg (0.524 
rad) left. 

a. Object^ Shape 3 and Size - There was very little difference in 
accuracy for viewing rectangles and cylinders. However, the sub- 
jects felt that rectangles were easier to align because of their 
predominate edge cues. 

When using unequal-size rectangles, where size cues could not be 
used as the primary cues, stereo viewing proved significantly 
better: stereo errors were less than half the monocular errors. 

For stereo viewing, aligning equal rectangles was four times as 
accurate as for unequal rectangles. Moreover, the experimental 
method (counterbalancing the order of mono and stereo and the di- 
rection of travel and having the smaller block stationary) gave 
additional cues, otherwise there would have been a greater dif- 
ference between using unequal and equal objects and between mono- 
scopic and steroscopic viewing. 

When using monocular TV and unequal-size objects, the test sub- 
jects commented that they could only guess as to where alignment 
occured, and they had no feel for alignment. The alignment er- 
rors with monocular TV covered the total possible range, whereas 
stereo viewing of unequal-size objects produced only a slight de- 
crease in mean accuracy and a similar increase in the variation. 
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d. Time - The data shown in Fig. VIII-4 indicate several apparent 
inconsistencies. However, one could account for these by hypoth- 
esizing that, alignment was faster in stereo for the easier tasks, 
and that since stereo viewing gave more information on the more 
difficult tasks, it took more time to use this additional infor- 
mation. 

e. Correction Accuracy - There appears to be about a 12% increase 
in accuracy between the initial alignment error and the corrected 
alignment error for mono and about a 5% increase for stereo. 

4 . Conclusions 

Stereoscopic TV permits adequate alignment for different-size ob- 
jects from any of the three viewing angles, but 30-deg (0. 524-rad) 
up viewing produces the best results. The LOM method for mono- 
scopic TV is adequate only for equal-size objects. Viewing is 
better at 30 deg (0.524 rad) up. The simulation used blocks which 
were side by side however, for objects atop one another, 30 deg 
(0.524) to the side might be better. But for objects that touch 
or circumscribe each other like a peg in a hole, there might be 
no difference between viewing at 30 deg CO. 524 rad up or 30 deg 
(0. 524 rad) to the side. 


D. SIMULATION OF A REMOTE MANIPULATION TASK 


The results of the basic simulation indicate the potential bene- 
fits of using stereoscopic TV and the proper viewing angle. 
However, several questions still remained unanswered. Is stereo 
viewing as good as having a second view? Does lighting affect 
performance? Can you generalize the results of simple align- 
ment in one DOF to a six- or seven-DOF manipulative task? The 
following pages consider these questions and give some general 
guidelines for the visual system. 

This second simulation was conducted to evaluate two manipulative 
tasks representative of the FFTO tasks. The dependent variables 
were task time and operator preference; the independent variables 
were the viewing dimension (3D or 2D), camera locations, number 
of views, and lighting levels. The major objectives were to de- 
termine if stereoscopic viewing was as good as two monocular views 
and to determine the effects of camera location and lighting on 
the visual system and task performance. 
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The basis for our simulation was an FFTO defined as follows: 

1) It was attached to, or otherwise fixed relative to, the 
task panel of a satellite; 

2) It had a six-or-more-degree-of-f reedom arm whose principal 
line of motion aligned within 45 deg (0.785 rad) of normal 
to the task panel. 

3) Only one light was available for performing the task (this 
allowed an evaluation of each lighting position independent 
of other lighting); 

4) The FFTO was not maneuvered during the task. 

Apparatus 

The manipulator arm used in the simulation analysis was a Central 
Research Laboratories (CRL) Model L arm with a general-purpose, 
alligator jaw-type end-effector. This arm is a master/slave, 
bilateral mechanical manipulator with a reach of about 1.5 m 
(5 ft). A screen was used between the master and slave so that 
the operator could use only the video system to perform the task. 

A task panel was made from aluminum and oak and mounted on a ply- 

wood panel as shown in Fig. VIII-5. Two tasks were used for this 
evaluation. One was inserting an oak block 1.9 cm (0.75 in.) by 
4.4 cm (1.75 in.) by 23 cm (9 in.) into each of three holes that 

were 0.16 cm (1/16 in.) larger than the blocks and oriented 0 deg 

(0 rad), 45 deg (0.785 rad), and 90 deg (1.571 rad) off the horizon- 
tal. The other task was inserting a 10-cm (4-in.) by 18-cm (7-in.) 
by 18-cm (7- in.) metal drawer into each of three metal guides that 
were 0.5 cm (3/16 in.) larger than the drawer and oriented 0 deg (0 
rad), 45 deg (0.785 rad), and 90 deg (1.571 rad) to the horizontal. 

The visual systems used were the fresnel stereoscopic system and 
the monoscopic system described in the previous section. The 
stereo display was rack-mounted above the two 25.4-cm (10-in.) 
monitors used for the monocular display (Fig. VIII-6) . The sec- 
ondary view for two-view stereo setups was displayed on the monitor 
directly under the stereo display, and the second monitor was 
turned off. 

Four experienced CRL arm operators were used as subjects. These 
operators normally use the CRL arms in Martin Marietta f s Environ- 
mental Effects Lab from 3 to 8 hrs each day. Eye examination re- 
sults for these subjects are given in Table VIII-5. 
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a) Straightaway Viewing 


b) 45 deg (0. 785-rad) Left Viewing 


Fig. VIII-6 Visual Display Setup for Manipulator Studies 
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pie VIII-5 Operators f Eye Examination Results 


’sual Parameter 

Operator 
1 CF 

Operator 
2 W V 

Operator 
3 OA 

Operator 

4 

GM 

iar Acuity 
Uncorrected 

R 

20/22 

20/18 

20/29 

20/22 

L 

20/22 

20/20 

20/33 

20/100 

Both 

20/22 

20/17 

20/22 

20/20 

ear Acuity 
Corrected 

R 

20/20 

NA 

20/25 

20/18 

L 

20/22 

NA 

20/17 

20/100 

Both 

20/20 

NA 

20/17 

20/17 

ar Acuity 
Uncorrected 

R 

20/69 

20/22 

20/40 

20/22 

L 

20/69 

20/20 

20/200 

20/100 

Both 

20/69 

20/18 

20/33 

20/20 

'ar Acuity 
Corrected 

R 

20/20 

NA 

20/22 

NA 

L 

20/20 

NA 

20/20 

NA 


Both 

20/20 

NA 

20/18 

NA 

lolor Vision OK 

OK 

0K 

OK 

OK 

epth Percep- 






tion 

751 

951 

1007c 

507c 

Jear Phoria 

| 




Vertical 

* 

OK 

5 (OK) 

5 (OK) 

Lateral 

* 

OK 

0 (NOT OK) 

6 (OK) 

Par Phoria 





Vertical 

* 

0K 

6 (OK) 

5 (OK) 

Lateral 

* 

OK 

8 (OK) 

i 

9 (OK) 

1 1 


* Not quite normal. 
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2 . 


Method 


Several pilot studies were conducted while training the operators 
so as to minimize learning affects and establish optimum camera, 
task panel, and lighting locations for the different setups • The 
setups resulting from these studies are shown in Fig. VIII-7 and 
summarized in Table VIII-6. The first five methods were one view 
methods and the last twelve were two view methods. 

Note that when the primary view camera was straight away, the 
monitor was straight away (Fig. VIII-6a) , and that when the pri- 
mary camera was 45 deg (0.785 rad) to the right, the monitor was 
located 45 deg (0.785 rad) to the left (Fig. VIII-6b) . This was 
necessary to keep the control axes aligned with the monitor axes. 
However, when the primary camera was located 35 deg (0.611 rad) 
up, the monitor was straight away and the operator was required 
to make a mental transformation in the X-Z plane. (The Y axis 
remains parallel to the horizontal axis of the monitor). 

Whenever possible the light was located on or near the primary 
view camera. The reasons for this are discussed in the next sub- 
section. 

Because of the amount of learning anticipated in performing our 
task, the order was counterbalanced for learning (i.e., mono was 
presented first half of the time and stereo was presented first 
the other half). In general, each subject was used to evaluate 
each test setup. 

The task was begun by grasping the block in the hole on the 
right, at which time the stop watch was started. The operator 
removed the block and inserted it, first into the left hole, then 
into the middle hole, and finally into the right hole, leaving 
it in the right hole. The operator then grasped the drawer in 
the top guide, removed it, and successively placed it into the 
bottom, middle, and finally back into the top guide. The total 
time required to perform the task was recorded. (The individual 
times required to perform each element of the task were also re- 
corded, but only the total time was used to analyze the data). 


VIII-16 



c) LOM (Horizontal) With Light d) LOM (35) 

25 deg (0.436 rad) to the Left 

Fig. VIII-7 Experimental Setups for Manipulator Task Simulation 
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Tab la VIII-6 Experimental Setups for Manipulator Task Simulation 


VIEWING METHOD 

CAMERA LOCATION 

LIGHTING 

LOCATION 

TASK PANEL 
ORIENTATION 

MONITOR 

LOCATION 

1. 

45 right 

45 dag (0.785 rad) 
to tha Right 

45 deg (0.785 rad) 
to the Right 

Vertical 

45 deg (0.785 rad) to tha 
Laft 

2. 

45/45 

45 dag (0.785 rad) 
to tha Right 

45 deg (0.785 rad) 
to the Right 

45 dag (0.785 rad) 
to the Vertical 

45 dag (0.785 rad) to the 
Laft 

3. 

45 down 

Straight Away 

Straight Away 

45 deg (0.785 rad) 
to the Vertical 

Straight Away 

4. 

LOM (horizontal) 

Straight Away 

10 deg (0.175 rad) 
to the Left 

Vertical 

Straight Away 

5. 

LOM (35) 

35 dag (0.611 rad) Up 

10 deg (0.175 rad) to 
the Right 

45 deg (0.785 rad) 
to the Vertical 

Straight Away 

6. 

LOM (horizontal) and 
90 right 

1) Straight Away (Mono 
or Sterao) 

2) 90 dag (1.571 rad) to 
tha Right 

Right for 25 dag (0.436 
rad) to tha Laft 

Vertical 

Straight Away 

7. 

LOM (horizontal) and 
45 right 

1) Straight Away 

2) 45 dag (0.785 rad) to 
tha Right 

10 deg (0.175 rad) to the 
Left or 45 dag (0.785 rad) 
to the Right 

Vertical 

Straight Away or 45 dag 
(0.785 rad) to the Laft 

8. 

LOM (horizontal) stereo 
and 45 right 

1) Straight Away (Sterao) 

2) 45 dag (0.785 rad) to 
the Right 

10 deg (0.175 rad) to the 
Laft 

Vertical 

Straight Away 

9. 

LOM (horizontal) and 
45 right stereo 

1) Straight Away 

2) 45 deg (0.785 rad) to 
tha Right (Stereo) 

45 deg (0.785 rad) to the 
Right 

Vertical 

45 deg (0.785 rad) to the 
Left 

10. 

LOM (35) and 45/45 

1) 35 deg (0.611 rad) Up 

45 dag (0.785 rad) to the 

45 deg (0.785 rad) 

Straight Away or 45 dag 


mono 

2) 45 deg (0.785 rad) to 

the Right 

Right 

to the Vertical 

(0.785 rad) to the Laft 

11. 

LOM (35) stereo and 
45/45 

1) 35 dag (0.611 rad) Up 
(Stereo) 

2) 45 deg (0.785 rad) to 
tha Right 

35 dag (0.611 rad) Up 

45 deg (0.785 rad) 
to the Vertical 

Straight Away 

12. 

LOM (35) and 45/45 

1) 35 dag (0.611 rad) Up 

45 deg (0.785 rad) to the 

45 deg (0.785 rad) 

45 deg (0.785 rad) to the 


atarao 

2) 45 dag (0.785 rad) to 

tha Right (Stereo) 

Right 

to tha Vertical 

Laft 

13. 

45 right and 45 laft 

1) 45 deg (0.785 rad) to 
tha Right (Mono or 
Stereo) 

2) 45 deg (0.785 rad) to 
tha Laft 

Straight Away 

Vertical 

45 dag (0.785 rad) to the 
Laft 

14. 

45/45 and 45/45 

1) 45 deg (0.785 rad) to 
tha Right (Mono or 
Stereo) 

2) 45 deg (0.785 rad) to 
tha Laft 

Straight Away 

45 dag (0.785 rad) 
to tha Vertical 

45 deg (0.785 rad) to the 
Left 

15. 

45 down and 45/45 mono 

1) Straight Away 

2) 45 dag (0.785 rad) to 
tha Right 

Straight Away or 45 deg 
(0.785 rad) to the Right 

45 deg (0.785 rad) 
to the Vertical 

Straight Away or 45 deg 
(0.785 rad) to tha Laft 

16. 

45 down atarao and 45/45 

1) Straight Away (Stereo) 

2) 45 dag (0.785 rad) to 
tha Right 

Straight Away 

45 deg (0.785 rad) 
to tha Vertical 

Straight Away 

17. 

45 down and 45/45 atarao 

1) Straight Away 

2) 45 dag/45 dag (0.785 
rad/0.785 rad) 
(Stereo) 

45 deg (0.785 rad) to 
tha Right 

45 deg (0.785 rad) 
to the Vertical 

45 dag (0.785 rad) to the 
Laft 
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3. 


Results and Conclusions 


The following discussion with tables describes the results for 
each experimental setup and gives general results for lighting, 
camera locations, number of views, stereo vs mono, and monitor 
orientation. The results fall into three categories: 

1) Results from the pilot studies. These results determined the 
test setups for the major experiment. 

2) Results from the major experiment. The major experiment 
evaluated those setups determined from the pilot studies. 

3) Results from postexperimental study. This study compared 
the best of the experimental setups. Some modifications 
were also evaluated. 

Each experimental setup was evaluated by the same operators and 
experimenters. Their comments are summarized in Table VIII-7. 

One of the operators had only 20/100 vision in his left eye and 
only 50% stereo acuity. This subject's preference for stereo 
over mono was apparent, but not as strong as the other subject's. 
Likewise, his mean task times showed very little difference 
between mono and stereo, although stereo was somewhat faster. 

The variances in the task times due to lighting location, task 
setup, operator learning and operator differences were too ex- 
cessive to find any statistically significant differences in mean 
task times at the 90% confidence level. However, the results were 
highly consistent across operators and experimental setups. 

It was concluded that stereo was better than mono for all camera 
locations. In fact, one stereo view was preferred over two mono 
views. Tasks which required the operator to make alignments in 
pitch or yaw were impossible using the one view mono unless the 
camera's LOS was normal to the pitch or yaw axis. Maintaining 
the LOS normal to the pitch and yaw axes was not always possible 
because of the manipulator arm or other object obstructing the 
camera's view. Therefore it was concluded that at least two mono 
views are required for an operational system. However one view 
stereo is sufficient even for these off axes alignments. 
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Table VI II -6 Subject Evaluation of Camera , Lighting, and Monitor Locations 
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General Principles Derived from Simulation 


a. Camera Location - For any manipulator am configuration in- 
cluding a bilateral master/slave am (electrical), it is assumed 
that the control system will allow control in monitor axes. That 
is, an up and down motion of the controller moves the slave up 
and down in the monitor; left and right of the controller are left 
and right in the monitor; and in and out are in and out of the 
monitor. In an actual FFTO system with a master/slave am, the 
relationship of the master am to the monitor and that of the 
camera to the slave am should be identical. (This was accom- 
plished in the simulation by keeping the monitor parallel to the 
prime viewing camera.) This assumes that control in monitor 
axes imposes no restrictions on camera location relative to the 
task. 

Assuming that control is accomplished in monitor axes, the next 
most important consideration of camera location is its relation- 
ship to the principal axes of the task panel. The optimum view 
of an alignment task is, of course with an LOS perpendicular to 
the axis of alignment. Therefore for a task with a close toler- 
ance for alignment in the Y axis, one would want the camera’s 
LOS perpendicular to the Y axis of the task. But since the 
simulation task panel was constructed for equal tolerances in both 
the Y and the Z (horizontal and vertical) axes, the operator 
required equal information on Y and Z alignment errors, but little 
information on X errors (nomal to the face of the panel) . There- 
fore, optimum viewing for Y and Z would be with the camera’s LOS 
parallel to the X axis, which would require estimating depth or 
size for X-axis alignment. 

If better alignment were required in X, then using off-axis align- 
ment — say 45 deg (0.785 rad) to the X axis — would give 0.707 times 
the X-axis resolution obtained with a normal axis alignment. If 
the 45 deg (0.785 rad) were towards the Y axis and remained normal 
to the Z axis, then the alignment resolution in Y would also be 
0.707 of that irom an axial alignment normal to the Y axis. 

As another example, if the off-axis alignment were 30 deg (0.542 
rad) downward, then the resolution relative to normal axis align- 
ment would be 100% in Y, 50% in X, and 86.6% in Z. In other 
words, the optimum camera location depends on the tradeoff of the 
resolution required in each of the three axes. 
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When one considers view or camera locations, it is important to 
consider monoscopic vs stereoscopic viewing. -For example, the 
preferred location for one-view stereo was 45 deg (0.785 rad) to 
the right because of the viewing problems due to the arm, shad- 
ows, and glare when the camera was pointed in the LOM. However, 
the required camera location for one-view monoscopic control 
was in the LOM because of the serious angle-estimation problems 
associated with the 45-deg (0.785-rad) location. 

Another Important consideration is the fact that the 45-deg 
(0.785-rad) right location was preferred to the 45-deg down/45-deg 
right location. For the latter location there are two angular 
estimates (pitch and yaw) required, whereas only one estimate is 
needed for the 45-deg (0.785-rad) right location. Moreover, the 
45-deg (0.785-rad) right location was preferred over the 45-deg 
(0.785-rad) down location by all operators because they felt the 
pitch angle was more difficult to estimate than the yaw angle. 

The time data supports these preferences. However, these subjects 
may be more accustomed to estimating yaw than pitch because they 
normally use these manipulators with a direct View of the slave 
and the LOS to the slave end-effector is usually nearly horizon- 
tal. 


b. Lighting - Lighting proved to be a much more critical variable 
than was anticipated. High contrast ratios, such as those found 
in space flight, mean that shadows or glare will entirely obscure 
the view of certain areas. 

For the simulation, usually one light was used at a time in order 
to evaluate each lighting position independently. However, it is 
felt that multiple light sources, diffusors, and reflectors should 
be evaluated in Phase II of this contract because of several prob- 
lems that were encountered with single light sources. For ex- 
ample, to minimize shadow effects in a one- light system, It was 
evident that the light should be located on or near the camera. 

In this manner any object that makes a shadow also blocks the 
camera's view of the area under the shadow. However, this ar- 
rangement could not be used when the cameras were mounted in the 
LOM (horizontal) or 45-deg and 45-deg (0.785-rad and 0.785-rad) 
locations. 

in the former case, the Intense glare from the face of the task 
panel reflected back into the camera. Positioning the light 10 
deg (0.175 rad) to the left not only eliminated glare, but also 
minimized shadows for manipulating blocks on the right of the task 
panel. In contrast, since the drawers were much larger, their 
alignment was not significantly affected by small shadows and 
lighting position was less critical. 
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For the 45-deg and 45-deg (0.785-rad and 0.785-rad) setup the 
light could not be placed on either camera because of reflections 
off the task panel and into the other camera. An obvious recom- 
mendation is not to have two cameras (in the same plane) with 
equal incidence angles to a reflective surface. 

The results of the major experiment indicate that lighting loca- 
tion is quite critical. For example, on two occasions with the 
LOM (horizontal) cameras, moving the light source only 15 deg 
(0.262 rad) — from 25 deg (0.436 rad) left to 10 deg (0.175) left — 
produced^ a greater than a 50% decrease in task time. And in 
several instances it was shown that, for a one-view stereo vis- 
ual system, shadow-filling lights were as beneficial as a sec- 
ond monocular view. From a systems point of view, additional 
lighting is preferable to additional views. 

c . Generalization of Reeulte 

Resolution Requirements - In this study the stereo vs mono evalua- 
tion was confounded with resolution since the stereo system had 
less resolution. The results indicate, however, that even a low- 
resolution stereo system is much more effective than a good-resolu- 
tion mono system. 

Head Motion Restrictions - The stereo vs mono evaluation was also 
confounded with head and torso restrictions since the stereo 
system required a precise head position. Here again, the results 
indicate that even a tightly restricted head-position stereoscopic 
system is much more effective than a less-restricting monoscopic 
system. Another important consideration is that the results ob- 
tained from the CRL master/slave manipulator system can be gen- 
eralized to other systems that require less torso motion. 

Primary Alignment Plane - The CRL simulation tasks were performed 
with all alignment in the plane of the task panel. Therefore, 
camera positions are identified with respect to the plane of the 
task panel and the results can be generalized to any alignment 
plane with respective camera positions. 
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SIMULATION OF SATELLITE CAPTURE AND INSPECTION 


The purposes of this simulation were to investigate the remote 
viewing problems associated with an FFTO and to evaluate the use 
of FFTO TV systems in capturing and inspecting a spinning and 
nutating satellite. The simulation consisted of two basic tasks: 
(1) satellite inspection, and (2) capture of a spinning and nutat- 
ing satellite. 

The simulation was performed using Martin Marietta f s Space Oper- 
ations Simulator. This simulator is a six-degree-of-f reedom, 
servodriven, computer-controlled device that uses a gimbaled at- 
titude head to produce three rotational degrees of freedom and 
a moving base to produce three translational degrees of freedom. 

The control station (Fig. VIII-8) consists of two translation 
controllers (one proportional and one on-off) at the operator’s 
left, a proportional rotation controller at the right, two black- 
and-white monocular TV monitors, a stereo display system, a foot 
controller, a pencil controller, a ten- turn potentiometer, and an 
oscilloscope-generated display. The two translation controllers 
provide signals to the simulated free-flying vehicle in the form 
of a rate or acceleration command, while the rotational controller 
operates in a rate mode. Only the rate mode was used for trans- 
lation during data collection because of the longer learning 
curve associated with the acceleration mode. 

Figure VIII-9 depicts the Free-Flyer with its manipulator and 
attached cameras. 

Manipulator length commands were generated with the on-off pencil 
controller, and the pitch of the camera and shoulder roll of the 
manipulator were controlled with the foot controller and. rota- 
tional pot, respectively. Since the camera on the manipulator 
arm only pitched with respect to the manipulator arm, the axes 
of the camera were continuously changing with respect to the 
free-flyer when the manipulator arm was rotating. The oscilloscope 
displayed a revolving "pip M , indicating the roll position of the 
manipulator with respect to the free-flyer. 

The free-flyer and attached manipulator were mathematically modeled 
and appropriately scaled on an EAI 231-R analog computer according 
to the equations given in Appendix A. The resultant scaled analog 
signals were applied to the moving base and attitude head of 
the simulator. 
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Fig. VIII-8 Control Station Mookup 


* 
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Fig. VIII- 9 Free-Fly er with Manipulator and Attached Camera 
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The viewing system consisted of two small black-and-white Norelco 
LDH-0050 TV cameras with 20-mm lenses, two 25.4-cm (10-in.) black- 
and-white Audiotronics MMA-10 TV monitors, and a stereo system. 

A complete description of the stereo system is presented in Sec-' 
tion VIII-B. 

For the stereo system, the two TV cameras were mounted side by 
side on the attitude head of the simulator with an 11-deg (0.192- 
rad) convergence angle and a 12.7-cm (5-in.) baseline. When the 
vehicle is to be operated with a monocular system, only one 
camera is used and its image is displayed on one of the 25.4-cm 
(10-in.) monitors. To convert between stereo and monocular TV 
viewing, the operator only needs to shift his head and look at 
the appropriate display, 

1, Task A - Satellite Inspection 

The purpose of this task was to evaluate visual systems for in- 
close maneuvering while maintaining a constant distance and 
angular orientation with respect to a satellite. Four test sub- 
jects were used. Each test subject performed the task four 
times — twice using monocular TV and twice using stereo TV. The 
inside of a full-size mockup of 1/2 of the Sky lab Orbital Work- 
shop (Fig. VIIJ^IO) was used for the target satellite. 

Each test subject was instructed to start from an initial position 
facing one of the storage lockers located on the interior wall 
of the mockup above the water tanks, and to fly along the top 
edge of the lockers, maintaining a constant perpendicular distance, 
until he had traversed the entire semicircular distance along 
the wall (see Fig. VI I I- 11) . Task times and X-Y plots of X-Y and 
Y-Z position were recorded, 

None of the test data demonstrated statistical significance at 
the 90% confidence level. However, there were two observations 
of interest, 

1) In 70% of the tests the subjects tended to fly the task 
smoother when using stereo TV. 

! 

4 2) In 75% of the tests the subjects tended to fly the task 
faster when using stereo TV, 

The above results are supported by the subjective comments of the 
test subjects. All subjects preferred stereo TV for this task. 
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One further point of interest concerning this task was the orien- 
tation of the light source with respect to the optical axis of the 
TV sensor. Although the surfaces of the mockup tended to be non- 
glaring, the light, because of its point-source characteristics, 
produced bright spots in the display that hindered the ability of 
the operator to retain an optimum view. This problem was par- 
tially resolved by moving the light source so that the lighting 
angle was about 60 deg (1.047 rad) to the sensor* s optical axis. 

For the inspection task, it was the subjective opinion of the 
test subjects and the experimenters that stereo TV was better 
than monoscopic TV. The subjects also felt that they could con- 
trol the FFTO more confidently in stereo than in mono; and 
although they were not skilled pilots, they felt fairly comfort- 
able flying the task. Moreover, during training and check out 
of the simulator, everyone preferred to use the stereo system 
because it was easier and more comfortable to fly. 

Task B - Satellite Capture 

One technique proposed for the capture of a spinning and nutating 
satellite is as follows: A manipulator arm is extended to an 

appropriate length and rotated to match the nutation rate of the 
satellite. The manipulator arm then tracks the spin axis of the 
satellite for final lock on. In order to perform this task how- 
ever it is required that the FFTO operator be able to approximately 
align the spin axis of the manipulator arm with the nutation axis 
of the satellite and to estimate the satellite’s nutation angle 
and rate in order to estimate the required length and rate of 
sDin of the manipulator arm. 

Therefore, the satellite capture simulation task was broken into 
two phases. The initial phase was to use a camera fixed to the 
FFTO in order to estimate the nutation angle and rate and to 
roughly align the X axis of the FFTO with the nutation axis of 
the satellite. The final phase was to extend and spin up the 
manipulator arm to match the estimated nutation angle and rate. 

Then using a camera on the end of a manipulator arm a final and 
precise tracking of the satellite spin axis was performed just 
before contact for capture. 

a. Phase I - Initial Alignment - To simulate a spinning/nutating 
satellite, a 1/20-scale model of 4.6-m (15-ft) diameter and 18.3-m 
(60-ft) long cylindrical satellite was constructed and attached 
to a spin motor (see Fig. VIII-12) . The combination of the cyl- 
inder and spin motor was then attached to a two-degree-of -freedom 
servodriven gimbal whose spin and gimbal rates were controlled 
via the analog computer. This configuration was capable of 
simulating spin rates from 0 to 100 rpm and nutation rates from 
0 to 10 rpm. 
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Fig. VIII- 12 1/20-Scale Model of the Satellite 

The operator's task was to estimate the nutation angle of the 
satellite from two positions relative to the satellite — parallel 
to the nutation axis, and perpendicular to the axis. 

After the test subject had estimated the nutation angle, he was 
instructed to align the attitude and position of the free-flyer's 
camera axis with respect to the nutation axis of the satellite. 

When the operator felt he was positioned on the nutation axis, 
his final conditions were recorded. 

The independent variables of interest were: (1) the initial loca- 

tion of the free-flyer — either 30.5 m (100 ft) to the side (with 
the satellite off to the left), or about 30.5 m (100 ft) out in 
front (with the satellite up and to the right) ; (2) nutation rate — 
0.0, 0.5, or 1.0 rad/sec (0.0, 28.7, or 57.3 deg/sec); (3) the 
satellites spin rate — 0, 5, or 10 rad/sec (0, 28.7, or 57.3 deg/sec); 
(A) the viewing dimension — either monoscopic or stereoscopic; and 
(5) reticles — either stereo or monocular. The dependent variables 
were the operator's estimate of the nutation angle, his alignment 
perpendicular to and parallel to the axis of nutation, and the time 
required to complete the task. Four nonpilot subjects were used 
in a counterbalanced experimental design which partially confounded 
subjects with each of the two way interactions of the first three 
independent variables. 

The effective stereo baseline for this phase was 127 cm (50 in.). 

The lighting source was located directly on top of the cameras 
and centered between the two stereo cameras. The reticles were 
positioned in front of the monitor face tor the monocular display 
and in front of the fresnel lens for the stereo display (see 
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Fig. VIII-13 and VIII-14) . The stereo reticle had only horizontal 
lines (since vertical lines require a more complex stereo display) 
and was used on both kinds of displays to compare monoscopic vs 
stereoscopic viewing without the effects of the different reticles. 
The monocular reticle was used on the monoscopic display to com- 
pare the effect of using a different reticle independent of the 
effects of stereo vs monoscopic viewing. 

b. Phase II-Final Alignment - In this sub task, the configuration 
was simulated by attaching a 1/4-scale model of the circular face 
of a cylindrical satellite (Fig. VIII-15) to the aforementioned 
spin motor, which was fastened to a two-degree-of-f reedom gimbal. 
However, the gimbal was fixed in a given attitude (i.e. , the nuta- 
tion angle) . The spin motor rotated the disk at the satellite 
spin rate, and the relative motion between the satellite and the 
camera attached to the manipulator was applied to the moving base 
and attitude head of the simulator according to the equations 
given in Appendix A. By inspecting these equations, one can see 
that, except for the spin of the satellite, the relative motion 
between the Ty camera and the satellite is due to the fact that 
the freeflyer’s X-axis (spin axis of the arm) is not boresighted 
in position and attitude with the cone axis of the satellite and 
the length and spin rate of the manipulator arm do not match the 
nutation angle and rate. 

The following paragraphs describe these sources of error that the 
operator must detect and correct. 

Spin Rate of the Arm - If the FFTO boom is spinning too slow (or 

too fast) with respect to the satellite’s nutation rate, the view 

of the satellite will be drifting at a constant rate to the left 
(or right) In the FOV. This can be corrected by speeding up (or 
slowing down) the arm using the ten-turn potentiometer on the 
simulator control panel. A displacement of the satellite left or 
right in the FOV (a phase error) can be corrected in a like manner. 

Length of the Spinning Boom - If the boom is too short, the satel- 
lite will be displaced up in the field of view; and if it is too 

long, the satellite will be too low. This can be corrected using 
the pencil controller. 

Tilt of the Camera - If the camera is pitched too far down, the 
center of the satellite will be up in the FOV but will also be 
tilted up. Therefore, the length of the boom and the tilt of the 
camera could be adjusted so that the camera is parallel to and 
boresighted to the satellite spin axes. 
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Fig. VIII-15 1/4-Soale Model of the Satellite 

These first three sources of error were not evaluated because 
the operator was told that they were not critical to the task, 
except insofar as he was to keep the center of the axis of ro- 
tation in the FOV to correct the errors described below. 

X Error - An error in X-axis alignment was not critical although 
the closer the operator flew, the smaller his other errors 
would be. 

Y and Z Errors - A Y-axis and/or Z-axis error in aligning the 
spin axis of the boom with the nutation axis of the satellite 
would make the spin axis of the satellite appear to circle clock- 
wise in the FOV if the nutation were counterclockwise. By 
knowing the location of the spinning boom relative to the Y and 
Z axes of the free-flyer when the satellite appeared at the top 
of FOV, the operator knew the direction of the Y and Z error. 

The radius of the circular motion then indicated the magnitude of 
the error vector in the Y-Z plane. 
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A revolving pip on the oscilloscope display indicated where the 
spinning boom was relative to the free-flyer coordinate system. 

The operator watched the circle made by the. satellite, and when 
it was at the top of his view he would look at the pip on the 
oscilloscope and command a translation in the direction of the 
spinning boom at that moment. 

Roll -There was no difference between controlling the roll of 
the free-flyer and controlling the spinning boom since the boom 
was spinning about the free-flyer 's roll axis. Therefore, roll 
was not used in the. simulation. Roll could, however, be used to 
move the satellite left or right in the FOV. 

Pitch and Yea) - A pitch and/or yaw error in aligning the spin axis 
of the boom (FFTO X-axis) with the nutation axis of the satellite 
made the satellite appear to oscillate in and out in the FOV. 
Again, the pip on the oscilloscope was used to indicate the boom's 
position. When the satellite was at its closest position in the 
FOV, the operator would pitch or roll towards the boom. In other 
words, if the boom were to the left, he would yaw left; and if 
the boom were up, he would pitch up. 

The IC alignment errors chosen for this task were somewhat larger 
than the mean errors resulting from the initial alignment phase. 
These initial conditions were +1.8-m (6 ft) in Y, +0.6-m (2 ft) 
in Z, -10.4-m (34 ft) in X, +3-deg (0.052-rad) in pitch, +3-deg 
(0.052-rad) in yaw, and 0-deg (0-rad) in roll. The effective 
stereo baseline for the stereo task was 38-cm. (15 in.). The light 
lng conditions and reticles were identical to those used in the 
initial phase of this task. 

The operator was instructed to keep the spin axis of the satellite 
within his FOV and to null all relative rates on his display 
(except for the spinning of the satellite) . When he felt he had 
nulled all relative rates, the computer was put in hold and the 
final conditions and total alignment time were recorded. 

o. Results - The results of the satellite capture simulation are 
shown in Table VIII-8 for both the initial alignment and the 
final alignment tasks. 
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Table VIII-8 Reeulte of the Satellite Capture Simulation * 


PARAMETER 

MEAN ERROR 

STANDARD DEVIATION 

Phase 

I - Initial Alignment 

. f 

Error of Nutation Angle, Viewed 
90 deg (1.571 rad) to Nutation Axis 
Monocular TV 
(Stereo Reticle) 

0.69 deg (0.0120 rad) 

0.74 deg (0.0129 rad) 

Stereo TV 
(Stereo Reticle) 

-0.25 deg (-0. 0044 rad) 

2.5 deg (0.0346 rad) 

Monocular TV 
(Monocular Reticle) 

0.0 deg (0.0 rad) 

2.74 deg (0.0472 rad) 

■ 

FFTO Angular Alignment Error_90 deg 
(1.571 rad) to Nutation Axis 
Monocular TV 

-6.54 deg (-0.1141 rad) 

3. 2. deg (0.0559 rad) 

Stereo TV 

-10.14 deg (-0.1770 rad) 

5.0 deg (0.0873 rad) 

FFTO Translational Offset from 
Nutation Axis at a Mean Distance 
of 31.8 m (106 ft) 



Monocular TV 

1.17m (3/9 ft) 

0.89 m (2.96 ft) 

Stereo TV 

0.84. m (2.8 ft) 

0.48 m (1.59 ft) 

FFTO Angular Offset from 
Nutation Axis at a Mean Distance 
of 31.8 m (104.3 ft) 

Monocular TV 

2.6 deg (0.0454 rad) 

0.87 deg (0.015 rad) 

Stereo TV 

1.6 deg (0.0279 rad) 

0.60 deg (0.0105 rad) 

Error of Estimated Nutation Angle, 
Viewed Parallel to Nutation Axis 
Monocular TV 
(Stereo Reticle) 

-5.1 deg (-0.0890 rad) 

9.26 deg (0.1616 rad) 

Stereo TV 
(Stereo Reticle) 

-0.2 deg (-0.0035 rad) 

2.64 deg (0.0461 rad) 

Monocular TV 
(Monocular Reticle) 

-4.1 deg (-0.0716 rad) 

6.6 deg (0.1152 rad) 

Phase 

II - Final Alignment 


FFTO Angular Offset from 
Nutation Axis, at a Mean Distance 
of 4.5 m (15 ft) 

Monocular TV 

1.2 deg (0.029 rad) 

0.98 deg (0.0171 rad) 

Stereo TV 

1.2 deg (0.029 rad) 

0.75 deg (0.0131 rad) 

FFTO Translational Offset 
from Nutation Axis at a Mean 
Distance of 4.5 m (15 ft) 
Monocular TV 

4.88 cm (0.16 ft) 

3.05 cm (0.10 ft) 

Stereo TV 

4.27 cm (0.14 ft) 

1.83 cm (0.06 ft) 


^Unless otherwise specified, each number refers to the mean performance 
using the "stereo" reticle. 
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None of the mono vs stereo comparisons demonstrated statistical 
significance, at the 90% confidence level. 

Figures VIII-16 thru VIII-18 are graphical presentations of the 
data for the 80% confidence interval (assuming the data has a 
normal distribution) ; this range of values corresponds to the 
mean value ± 1.28 standard deviations. Assuming that the mean 
and standard deviation are good estimates of the true mean and 
standard deviation, four out of five trials will fall within this 
range of values for the conditions specified. 

d. Conclusions 

Monocular TV vs Stereo TV - In both the initial alignment and final- 
alignment tasks, reticles were used on the TV monitor as a dis- 
play aid for making absolute and relative judgments of size, 
motion, attitude, shape, azimuth, and elevation. Stereo TV is 
primarily a display aid for making absolute and relative judgments 
of depth. Therefore, unless a task requires significant depth 
alignment, a stereoscopic TV system would be of little benefit 
over a monocular system with an appropriate reticle. There does 
not appear to be any difference between monoscopic and stereo 
viewing in tasks that require some sort of alignment reticle 
(based on results for four subjects, with four simulation runs for 
each). Moreover, the subjects preferred the monocular system be- 
cause of its better reticles, better resolution, freedom of head 
movement, and lower fatigue. 

Monocular Reticle vs Stereo Reticle - Although the data do not 
show any significant performance difference between the stereo 
reticle (all horizontal lines) and the monocular reticle (ver- 
tical cross hairs and angles), the subjects felt much more con- 
fident using the monocular reticle to estimate the nutation angle 
from the side. Note that the range of data for the "monocular TV 
(monocular reticle)" alignment error estimated from the side (ref 
Fig. VIII-12) includes data from one run with a very large error; 
otherwise, the 80% confidence interval would be much tighter. 

For estimating the nutation angle from the front, the subjects 
had a very small preference for the stereo reticle, but otherwise 
the monocular reticle was subjectively easier to use in both the 
initial -alignment and final-alignment tasks. 
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Nutation Angle Estimation 









VIII-37 


Initial Alignment Final Alignment 

Fig. VIII- 17 Mean and 80% Confidence Interval for Y and Z 
Alignment Error (Stereo Reticle) 
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VIII-18 Mean and 80% Confidence Interval for Resultant Pitch 
and law Alignment Error 





The problem with using a stereo reticle that has any vertical lines 
and is placed on the fresnel lens or anywhere else between the 
monitors and the eye is that it will appear to be located a con- 
stant distance from the eye. And like lining up your finger with 
a distant object, it cannot be aligned with both eyes: you must 

either move your finger out and touch the object, shut one eye, 
or allow the dominant eye to do the alignment. In either case, 
you might as well have only a monoscopic view. With a stereo 
reticle, the vertical line must overlay the object being aligned 
in order to use both eyes for alignment. 

A reticle for stereo TV can be made by using two reticles, one 
on the face of each stereo monitor. By changing their relative 
horizontal positions, the operator can change the reticle. 1 s 
apparent distance from the eye and thereby cause the reticle to 
appear on the object of interest in the stereo view. This can 
also provide optical ranging information. Once the relative hor- 
izontal positions of the reticles are known, the distance between 
the cameras and the object of interest in the stereo view may be 
determined. Therefore, the operator could adjust his reticle "in 
and out” until it appeared to be in the same plane as the target, 
at which time a numerical readout of his reticle position would 
be proportional to the range to the target. 

Spin and Nutation Rate Estimations - It was shown to be quite easy 
to detect and determine nutation angles in excess of 0.4-deg 
(0.007-rad) at nutation rates of 1 rad/sec (57. 3-deg/sec) ana 
0.25-rad/sec (14. 3-deg/sec) . These angles are easier to detect 
from the side than from the end. Spin rates up to 10-rad/sec 
(573-deg/sec) and nutation rates up to 1 rad/sec (57. 3-deg/sec) 
were easily and accurately determined by all test subjects using 
a stop watch. (In actual operation the operator should count the 
number of revolutions at least twice as a precaution, because on 
one occasion a test subject miscounted. 

Nutation Angle Estimates - The data indicated that when estimating 
nutation angles between 0.0-deg (0-rad) and 26.5-deg (0.463-rad) 
the test subjects could determine these angles to less than 4-deg 
(0.070-rad) when viewing the satellite from the side, but to only 
16-deg (0.279-rad) when viewing the satellite from the end. Stereo 
viewing tended to be more accurate than monoscopic TV in both 
cases (with the same reticle). 

Lighting - Lighting is not a problem when the object of interest 
has a smooth, nonglaring surface and light is not reflected 
directly back into the camera. 
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IX. 


CONCLUSIONS 


1) The visual system must be a TV system. 

2) The system components are within the state-of-the-art, except 
for monitors in the 25.4-cm (10- in.) to 30.5-cm (12-in.) 
range. 

3) Stereoscopic TV allows good depth alignment from any viewing 
angle. In contrast, monoscopic TV allows good depth align- 
ment from relatively few viewing angles. 

4) For manipulative tasks, a two-view (two-camera) monoscopic 
system and a one-view (two-camera) stereoscopic system are 
approximately equivalent. For optimum viewing angles, light- 
ing, and shadow suppression, stereo is better than mono. 

When the single stereo view is obscured by objects, shadows, 
or glare, the stereo camera may have to be moved before the 
task can continue. Therefore, it is better to use a one-view 
monoscopic, one-view stereo (three-camera) system to reduce 
camera-motion requirements during the task and provide re- 
dundancy. 

5) For capturing a spinning and nutating satellite where a reticle 
is the primary visual aid, a stereo system is not much better 
than a monovisual, except for optical ranging. 

6) When close maneuvering is required for satellite inspection, 
a stereoscopic system is desireable, but not required, 

7) From a hardware viewpoint, a two-camera monoscopic display 
system and a stereoscopic-f resnel display system are equiv- 
alent on a volume, weight, and bandwidth basis; however, the 
stereoscopic system requires less power and less complex 
articulation mechanisms. 
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RECOMMENDATIONS 


PRELIMINARY VISUAL SYSTEM CONCEPT 


The proposed baseline FFTO visual system is a flexible, mission- 
dependent combination of monoscopic and stereoscopic television. 

The recommended configuration for satellite maintenance and in- 
spection is to use three cameras, as shown in Fig, X-l. Two 
identical stereo cameras are placed on a short deployable boom 
that provides a stereo view of the manipulator work envelope and 
four sides of the free-flyer vehicle. One pan/tilt unit is at 
the bottom of the boom and another is directly under the stereo 
cameras . 

The two stereo lenses are placed 12.7 cm (5 in.) apart and have 
an 11 deg (0.192-rad) convergence angle, which provides an optimum 
stereo image from 38.1 cm (15 in,) to 9.1 m (30 ft). The lenses 
are 20 mm, which provides a 27 deg (0.471-rad) horizontal field 
of view; this field of view eliminates the need for a complex, 
automatic, end-effector tracking capability for presently pro- 
posed maintenance tasks. 

A monoscopic camera with a remote-controlled, 12.5- to 75-mm 
zoom lens is located on the lower, forward corner of the free- 
flyer and is mounted on a pan/ tilt unit. This camera, while 
normally not used, provides redundancy and an overall view of 
the manipulator when the task requires the stereo-pair to be close 
to the manipulator end-effector. 

For satellite retrieval when the satellite is not spinning, the 
same kind of camera configuration is used (see Fig, X-2). 

For the worst-case nutating /spinning retrieval mission, the manip- 
ulator must be >7.6 m (^25 ft) long. To eliminate additional 
length requirements, a camera is mounted on the manipulator, as 
shown in Fig. X-3. The simulations indicated that this task 
could be accomplished using a monoscopic view. However, if mainte- 
nance is required after the capture phase, the long manipulator 
would be used to support and position a stereo viewing pair, and 
the maintenance activity would be accomplished with a smaller, 
general-purpose manipulator. 





Fig. X-2 Camera Locations for Satellite Retrieval 
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The displays and controls for the visual system are shown in 
Fig. X-4. This configuration was made without regard to the 
free-flyer subsystem controls and displays, which will be inte- 
grated as they are defined. 

Two, 30.9-cm (12.5-in.) diagonal, black-and-white TV presentations 
are provided to the operator. The fresnel lens stereo unit is 
located on the right, a standard monoscopic monitor on the left. 
The stereo display contains two small monitors and, therefore, 
needs two standard controls. 

Selector switches are provided to allow any of the cameras to be 
viewed on either display, in mono. The stereo display may be used 
as a monoscopic display by selecting the desired camera, shutting 
off either monitor, and using a mechanical lever on the right 
side of the fresnel lens to position a ground glass behind the 
fresnel lens. The ground glass has an alignment grid inscribed 
on its face that is identical to the grid shown on the monocular 
monitor . 

In general, the stereoscopic system will be used for tasks re- 
quiring a high degree of manipulator dexterity and the monoscopic 
system will generally be used for gross vehicle alignments, single 
contacts, and overall task views. The "nutating tracking" display 
is provided directly above the stereo monitor to aid the operator 
in aligning the free-flyer with the satellite's nutation axis. 

This visual alignment technique is employed for the retrieval 
concept shown in Fig. X-3 and described in Section VII-E. 

The remainder of the console contains standard camera, lighting, 
and pan/ tilt controls. The video transmission link control en- 
ables the operator to switch transmitters in case of a failure. 


B. PHASE II STUDY 


During Phase I, the primary emphasis has been placed on developing 
visual system concepts and evaluating these concepts so that a 
system selection may be made. No detailed concept analysis has 
been performed, and no attempt has been made to optimize a single 
visual system concept in terms of subsystems and interactions 
between subsystems. Therefore, during Phase II, further studies 
and man-machine simulations must be performed before a preliminary 
design can be effected. 
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These studies should consider the following items: 

1) Color vs black-and-white TV; 

2) Lighting; 

3) Visual aids such as mirrors, computer-augmented displays, and 
stereo reticles; 

4) Ranges and control methods (automatic vs manual) for deploy- 
ment/articulation mechanisms; 

5) Noise and bandwidth limitations; 

6) Continuous (zoom) vs discrete (turrent) field of view, 

However, the primary areas to be emphasized during the Phase II 
gtudy will be based upon the recommendations of the NASA. 
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Fig. X-4 Visual System Displays and Controls 
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APPENDIX--DERIVATION_OF_FREE-FLYER_SIMULATION_EQUATIONS* 


This appendix presents the derivation of the equations of motion 
used in FFTO simulations to evaluate the two candidate visual 
systems. Two tasks were selected: Task 1 was an inspection task 

using a single camera (or stereo pair) mounted on the free-flyer, 
and Task 2 was an alignment task where the operator must align 
the axes of the free-flyer with the nutation axis of a spinning, 
nutating satellite. 

For simulation purposes, Task 2 was divided into two parts. The 
first part, a gross alignment from a separation distance of be- 
tween 50 and 100 ft (15.2 and 30.5 m) , used the same equations 
and free-flyer as Task 1. The second part assumed that the TV 
camera was mounted on an extended, rotating arm attached to the 
free-flyer so that it can effectively track the face (or cylinder 
end) of the rotating satellite. For all tasks, the TV camera (or 
stereo cameras) was mounted on the attitude head of the space 
operations simulator. 

The equations derived in this appendix were programmed on an EAI 
231-R analog computer that is used to drive Martin Marietta's 
6 -DOF space operations simulator described in Chapter VIII. The 
simulation setup presents to the operator a realistic TV scene 
and motions resulting from input commands that are representative 
of actual, spatial free-flyer tasks. 

The notation used in developing the equations is as follows: 
vectors are denoted with an overbar, and matrices are denoted by 
a double overbar. Subscripts preceding a vector denote the axis 
system in which the vector is resolved. A double subscript fol- 
lowing a transformation matrix. denotes the references between 
which the transformation is to take' place. Thus 3 R 2 _refers to 
the vector R 2 resolved in coordinate system 3, and 0 R 2 refers to 
the same vector resolved in coordinate system 0. The matrix 
D 30 is the transformation matrix from coordinate system 3 to co- 
ordinate system 0. A double subscript following an angle indic ates 
the two ref erence. systems the angle measures between. For example, 
^32 is the Euler angle locating reference 3 with respect to ref- 
erence 2. The transformation matrices used in the following der- 
ivations are obtained from Appendix B of EVA/IVA Simulation Dy- 
namics by J. R. Tewelland C. H. Johnson, Research Report R-67-8,. 
Martin :Marietta Aerospace, Denver, Colorado, February 1967. 


*The work described in this appendix was performed under IRAD 
Task 48664. 
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Symbol 

Definition 

D 

Denotes transformation matrix D 

d 

Elements of D V : . 

F 

Thrust force of free— flyer 

L 

a 

Length of free-flyer rotating arm 

L 

n 

Perpendicular distance from nutating axis to 
intersection of satellite spin axis and front 
face 

M 

Mass of free flyer 

p» q. r 

Roll, pitch, and yaw angular rates about x, y, and 
z free-flyer body, axes 

R 

Position vector 

S 

Position vector „ 

t 

Time 

x,y,z 

Denotes coordinate axes 

X 

n 

x component of 

V V z o 

Components of S 

1,1,1 
x y z 

Unit vectors in the x, y, and z directions 

<P, 9, i|>, 

Roll (x) , pitch (y) , and yaw (z) Euler angles 

OJ 

Angular rotation rate 


1. Task 1 and Task 2a • 

For Tasks 1 and 2a, the equations involved are merely those con- 
nected with the free-flyer itself, namely those giving (1) trans- 
lational motion of the free-flyer in an inertial axis system and 
(2) the Euler angles locating the body fixed axis relative to 
the inertial axis. For Task 1 a stationary target mockup was 
used for inspection, and for Task 2a a scaled model of a spinning. 
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nutating satellite was mounted in a two-axis, servo-driven gimbal 
system that used a separate spin motor to produce the spin and 
nutation. The two-axis gimbals were driven with computer-generated 
sine and cosine functions to obtain the nutation. 

a. Coordinate Systems 


Inertial 

Origin 



x o , y , z q = Inertial System 

xj , yj, zi = Rotating System = Free-Flyer Body Axis System 

b* Equations of Motion - The body axis rates (p, q, and r) are 
determined from the inputs of the rotational hand-controller. 

The Euler angle rates — -assuming a roll, pitch, yaw sequence (sim- 
ulator attitude head sequence) — are then obtained using the rate 
transformation 










cos \p/cos 0 

. -sin ip/cos 0 

0 


p 

e 

= 

sin \p 

cos ip 

0 


q 

A 


-cos ip sin 0 

sin jp sin 0 

1 




cos 0 

cos 0 


r 
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These Euler angle rates are then integrated to obtain the Euler 

angles, from which the transformation Di 0 , from the body-axis sys 
tem to the inertial-axis system, can be calculated. The Euler 
angles (<f>, 6, and \p) drive the simulator attitude head gimbals 
directly. 

The inputs to the translational hand-controller are used to de- 
termine iR, the acceleration of the free-flyer in the free-flyer 
body axis system, which is calculated as 



Transforming this expression into the inertial-axis system and 
integrating - gives - the - three— car-r-i-age— commands 

q R = // Dio 1* <*t d t- 

To simplify translational control of the free-flyer, a velocity 
(instead of acceleration) control mode was also implemented. 
When this mode was used the carriage commands were given by 


q R ■ / Dio iR dt * 

Task 2b 

In this task the relative motion between the face (or cylinder 
end) of the nutating satellite and the camera located on the 
rotating arm must be determined. This relative motion consti- 
tutes the commands to the simulator's translational motion car- 
riages . 

For this simulation, the mockup of the satellite was given the 
same spin as the satellite and was constructed so that the fixed 
face angle was equal to half the cone angle. Consequently, the 
relative angular orientation required to drive the attitude 
head was only that orientation relating the position of the .TV 
camera to the inertial system. Figure A-l depicts the spatial 
free-flyer, arm, camera, and satellite configuration. 
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x 3 » y3» 2 3 


Rotating system - free— flyer body axis system; has 
same origin as X 2 , y 2 > Z 2 


X 4 , y 4 , Z 4 = Rotating system - fixed in rotating arm of free- 
flyer; has same origin as X 2 , y2* z 2 

x 5 » ys. z 5 = Rotating system - fixed in camera on end of arm; 
rotates in pitch relative to X 2 , y2> z 2 

x 6 > y 6 » z 6 = Nonrotating system - located at intersection of 
satellite spin axis and front face. 

Assumptions 

1. Spinning arm is connected to free-flyer at its eg and produces 

no-dynamic_r.eac.tion_to_the_f r.ee=fly_er_. 

2. Free-flyer yaw and pitch attitudes are small angles. 

3. Spinning rate of arm is approximately equal to rate of sat- 
ellite nutation. 

4. Satellite is coning at nutation rate u>. 

5. Camera on end of arm rotates with arm. 

Trans lational Mot-ion Equations - In axis 4, the arm length is given 
by 



where L is the arm length and is allowed to vary. Axis 4 is ro- 

a 

tating relative to 3 at the arm rotation rate ($ 43 ) about the X 4 
axis only. Then in 3, ' 

3 R = D 43 ($ 43 ) 4 R 

or 


3^ = \ + ( L a sin 4*43) + (-L fl cos 4>43 ) 

where ^43 = I <#>43 dt. 
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Axis 3 is located relative to 2 by the Euler angles 032 » 
and <f> 3 2 and a sequence of yaw, pitch, ana roll. Assuming 
angles for 032 and 632* and transforming 3R to the 2 axis 

2R = D32 (032» e 32» ^32) 3^ 
or 

2 R = I x j^(© 3 2 sin <(>32 “ 032 cos <p 32 ) L a sin <^43 - 
( 9 32 cos 3 2 + 032 sin 0 32 ) L q cos 043J 


+ 

1 

y 

^cos 

0 32 

L s 
a 

in 043 + 

sin 

<(>32 

L cos 
a 

<(>43 

+ 

I 

z 

sin 

03 2 

L sin 043 - 

a 

cos 

<(>32 

L cos 
a 

<(>43 

Combining 

roll angles. 






2 R = 

I 

X 1 


®32 

cos 

042 - L a 

032 

sin 

$42^ 


+ 

i 

y 

K 

sin 

042 






+ 

I 

z 

-L 

a 

cos 

042 







where 42 = 043 + 032* 

The location of the tip of the arm from the_origin of the 
inertial-axis system is obtained by adding S to 2^> where 

S = I X +1 Y +1 Z. 

0 x 0 y 0 20 

Thus , 

Q R a = l x |x 0 - L a 632 cos 042 - L a \p 32 sin <*>42 J 
+ I y j^Y Q + L a sin 
+ l z - L a cos 042 J 


e 32 > 

small 
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For simulation purposes it was desired to obtain the relative 
motion of the nutating satellite with respect to the tip of the 
free-flyer manipulator arm. 

The vector R , which locates the point of intersection of the 
on 

satellite spin axis and the front surface with respect to the 
origin of the inertial-axis system, is given by 

R = T (,X I + I L (sin ut) - I L (cos cot) , 
on xvrw yn zn 

where co is the constant nutation rate of the nutating satellite. 
The relative motion of the satellite with respect to the tip of 
the manupilator arm is then 

R_ = R. - R 

o k o a on 

= l x - L 632 cos <(>42 “ L a ^32 sin d> 4 2 J 

+ I |*Y + L sin $42 - L sin cotl 

y (_ o a n J / 

+ 1 I Z - L cos d>4 ? + L cos cotl . 

z L o a n I 

Angular Relationship Equations - The angular commands that are 
sent to the attitude head of the space operations simulator are 
obtained by equating proper transformation matrices that relate 
the attitude of the free-flyer camera to that of the nutating 
satellite. 

The transformation from the camera-axis system to the inertial- 
axis system is given by 


D50 - D20 ( 0 ) D32 ( 4*32 » ® 32 » 3 2) d 43 (<(>43) D54 (654). 

The elements of D50 must then equal the elements of the trans- 
formation of the simulator attitude head, which has a roll, pitch, 

and yaw sequence, D (<f>, 9 , ip ) . From this transformation, the 
head angles are found to be: 

sin 0 = i3d 50 ; 


tan ip = -l2d5o/lld5o5 
tan 4> = “ 23 ^ 50 / 33^50 • 
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Multiplying the matrices as indicated for D50 (assuming small 
angles for $32* ® 32 > anc ^ 654)* we obtain the following equations: 

0 = 632 cos 4*42 $32 $42 + ® 54 > 

ip = -632 sin <j >42 + $32 cos $4 2 » 


$ - $ 42 ' 


Since the simulator f s roll gimbal cannot continuously roll according 
to 4 “ $42 $ the translational motion of the target due to this 
roll can be obtained by transforming ^R^ into the 1 axis, which 

is rotating relative to the inertial axis at $42* Thus, 

1®R = D 0! (<J>4 2) Q \' 


Assuming that the angular rate <£42 is always approximately the 
same as the nutation rate oj(i.e., if $^ 2 “ wt is a small angle), 
then iRp becomes 


- I f 

1 R x (_ 

+ M 


+ 1 


X Q - x n - 0 32 COS $42 - \ p 32 sin $ 42 

y^ cos $42 - z^ sin $42 + ($42 “ cot)J 

]• 


-y sin $40 + z cos $49 + L - L 
J o o n a 


The components of iR^ are the x, y, and z translation commands 

to the space operations simulator. Both 4)42 and L were manually 

a 

varied from the operator T s console during the simulations. 


The attitude angles to the simulator are the same as before, 
except for $, which is zero. The effect of $ = 0 is that the 
target will be seen to rotate at its spin rate, instead of at one 
less than the spin rate, which is the case in space. This effect 
will not influence the results of the simulation. 
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